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foreword 


The  Army  Research  Institute  -  Fort  Knox  Field  Unit  has  been  working  toward 
solution  of  training  and  performance  problems  that  result  from  the  Army’s  ac¬ 
quisition  of  sophisticated  new  weapon  systems.  The  research  has  focused  on 
the  development  and  fielding  of  the  Ml  "Abrams"  Tank.  Problems  in  personnel 
selection  and  assignment,  individual  and  crew  training,  and  training  and  per¬ 
formance  in  units  are  being  investigated. 

The  Ml  "Abrams"  Tank  has  sophisticated  automotive  and  fire  control  systems 
that  make  it  unique  among  armor  weapon  systems.  Such  features  as  turbine  en¬ 
gine,  digital  computer,  laser  rangefinder,  thermal  Imagery  sight,  and  lead 
angle  sensor  simplify  combat  operations,  but  make  preparing  to  fight  more  com¬ 
plicated.  They  also  require  that  crewman  be  able  to  identify  when  these  sys¬ 
tems  have  failed  and  how  to  use  backup  systems.  Differences  in  fire  controls 
has  meant  that  changes  be  made  in  the  fire  commands  and  responses  that  communi 
cate  information  during  combat  engagements.  These  differences  in  performance 
requirements  of  the  Ml  have  been  addressed  in  this  project  within  a  more  gen¬ 
eral  goal  of  producing  training  materials  that  are  appropriate  for  use  in  Army 
operational  units. 

This  research  report,  "Development  of  Ml  Abrams  Tank  Sustainment  Training 
Materials,"  describes  the  development  and  tryout  of  materials  designed  to  aid 
Ml  crewmen  in  performance  of  the  long  complicated  tasks  required  to  prepare 
for  operations  and  to  teach  them  Ml  fire  commands,  degraded  mode  gunnery,  and 
laser  rangefinder  techniques.  The  sustainment  training  materials  take  the 
form  of  procedures  guides,  knowledge  and  workbooks,  and  practice  exercises. 
Application  of  some  of  the  methods  described  in  this  report  have  already  been 
applied  to  other  weapon  systems. 

The  materials  described  in  the  report  provide  training  on  Ml  unique  tasks 
and  skills  and  knowledges.  The  training  approaches  used  are  of  importance  be¬ 
cause  they  aim  at  providing  materials  that  can  be  used  directly  within  the 
armor  training  environment  by  the  principal  trainer,  the  tank  commander.  Use 
of  these  materials  and  materials  like  them  have  potential  for  Improving  per¬ 
formance  on  new  weapon  systems  such  as  the  Ml  tank. 

EDGAR  M.  JOHNSON 
Technic  \  Director 


PREFACE 


This  document  reports  on  a  research  project  in  which  procedure  guides  and 
skill  sustainment  training  materials  were  developed  for  use  by  Ml  tank  crews. 

The  research  was  performed  by  Allen  Corporation  of  America  under  sub¬ 
contract  to  Systems  Research  Laboratories,  Dayton,  Ohio.  Dr.  James  J.  Vaughan 
served  as  the  Allen  Corporation  Program  Manager. 

This  research  was  supported  by  the  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  under  Contract  No.  MDA9Q3-81-C-QG31,  "XM1  Tank 
System  Training  and  Aptitude  Requirements."  The  project  was  monitored  techni¬ 
cally  by  Dr.  StepheaL.  Goldberg  and  Mr.  Ronald  E.  Kraemer  of  the  U.S.  Army 
Research  Institute.  Their  assistance  and  support  in  this  research  effort  is 
greatly  appreciated.  The  authors  also  wish  to  express  gratitude  to  all  per¬ 
sonnel  at  the  New  Equipment  Training  Team,  Fort  Knox,  Kentucky,  and  the  Fort 
Hood,  Texas  Ml  units  who  provided  assistance  and  participated  in  this  reaserch 
project. 
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DEVELOPMENT  OF  Ml  ABRAMS  TANK  SUSTAINMENT  TRAINING  MATERIAL 


BRIEF 


Requirement: 

The  purpose  of  this  research  was  to  (1)  design  and  develop  Ml  crew  proce¬ 
dure  guides  for  tasks  performed  before,  during,  and  after  tank  operations;  and 
(2)  design,  develop  and  evaluate  low  cost  sustainment  training  materials  for. 
skill  enhancement  on  various  tank  combat  tasks. 

Procedure: 

The  Ml  procedure  guides  were  developed  via  analysis  of  task  procedures 
and  identification  of  all  decisions  made  by  the  operator  during  task  perform¬ 
ance.  Sustainment  training  materials  developed  were  of  two  types  --  scenarios 
and  field  exercises.  These  sustainment  training  materials  were  evaluated  on 
two  separate  occasions  at  Fort  Hood,  Texas.  Current  Ml  tank  crewmembers  par¬ 
ticipated  in  both  of  these  evaluations.  Data  were  collected  relating  to  util¬ 
ity,  acceptability  and  training  effectiveness  of  the  materials. 

Findings: 

The  Ml  crew  procedure  guides  appear  to  be  extremely  effective  job  aids 
for  the  performance  of  operational  tasks  having  many  procedural  steps.  In 
addition,  the  scenario-style  booklets  proved  to  be  both  training-  and  cost- 
effective  tools  for  the  Ml  community.  Finally,  the  concept  and  format  of  the 
sustainment  training  materials  were  favorably  accepted  by  the  crewmen. 

Utilization  of  Findings: 

These  low-cost  media  should  be  evaluated  to  assess  effectivenesss  in 
training  (1)  additional  tasks  within  the  Ml  community,  and  (2)  similar  tasks 
in  other  communities,  such  as  the  M60A1,  M60A3,  M551,  M109,  M110,  and  so  on. 
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SECTION  I 


INTRODUCTION 


Allen  Corporation  of  /Vnerica  has  completed  work  on  an  effort  entitled 
"XM1  TanK  System  Training  and  Aptitude  Requirements".  This  contract  (MDA9Q3- 
31-C-Q031)  was  initiated  by  the  U.S.  Army  Research  Institute  for  the  Benav- 
ioral  and  Social  Sciences  ( AR I )  and  funded  by  the  Defense  Supply  Service, 
Washington,  DC.  The  contract  consisted  of  two  overall  objectives: 

•  Objective  1  -  develop  an  XM1/M60A3  crewman  aptitude  measurement  methodol¬ 
ogy,  evaluate  identified  aptitude  requirements,  and  provide  an  implemen¬ 
tation  program  for  use  by  command  personnel  in  operational  units. 

•  Objective  2  -  design,  develop,  pilot  test,  and  implement  an  XM1  tank  crew 
sustainment  training  program  for  use  at  the  platoon  level  in  operational 
units. 

Systems  Research  Laboratories  (SRL)  of  Dayton,  Ohio  is  presently  complet¬ 
ing  activities  encompassing  Objective  1.  This  document,  prepared  by  Allen 
Corporation,  comprises  the  final  report  related  to  Objective  2. 

SCOPE  OF  WORK 

Following  the  award  of  the  contract,  Allen  Corporation  prepared  a 
research  plan  detailing  the  various  activities  to  be  performed  during  the 
effort.  Specifically,  Allen  Corporation  was  responsible  for: 

1.  Development  of  procedure  guides  and  plans  for  use  by  the  XM1  crew 
(tank  commander  (TC),  gunner,  loader,  and  driver). 

2.  Training  analysis  of  selected  tank  crew  tasks  leading  to  the  develop¬ 
ment  of  appropriate  skill  sustainment  materials. 

3.  Development  of  individual  skill  sustainment  materials  and  management 
plan  for  in-tank  individual  and  crew  use. 

4.  Evaluation  and  revision  of  individual  skill  sustainment  materials. 
CONTENT  OF  THIS  REPORT 

This  report  has  been  designed  to  describe  Allen  Corporation  activities 
during  the  performance  of  the  above  tasks.  Further,  it  provides  information 
on  personnel  and  management  conditions  which  affected  the  conduct  of  those 
activities.  The  report  ends  with  research  conclusions  and  recommendations. 
Specifically: 

•  Section  II  -  Describes  the  process  and  activities  used  by  Allen  Corpora¬ 
tion  in  the  development  of  the  Ml  Procedures  Guides  and  Sustainment 
Training  Materials. 
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•  Section  III  -  Describes  the  material^  evaluated,  and  procedures  employed 
during  the  first  field  evaluation,  m  addition,  results  of  that  evalua¬ 
tion  are  presented. 

•  Section  IV  -  Describes  the  second  field  evaluation  in  terms  of  the  mate¬ 
rials  and  procedures  employed,  and  results  obtained. 

•  Section  V  -  Presents  conclusions  based  on  results  of  the  field 
evaluations. 

•  Section  VI  -  Presents  recommendations  for  potential  future  research 
activities  related  to  armor  unit  training. 


SECTION  II 


OVERVIEW  OF  MATERIALS  DEVELOPMENT 


During  the  conduct  of  this  effort,  two  categories  of  training  materials 
were  developed.  The  first  were  Ml  crew  procedure  guides.  The  second  were  Ml 
crew  skill  sustainment  materials.  The  general  description  of,  and  process 
for,  the  development  of  each  of  these  products  is  described  below. 

Ml  CREW  PROCEDURE  GUIDES 

The  initial  concept  of  the  procedure  guides  was  documents  which  would 
recite  tank  procedures  and  be  packaged  in  a  format  suitable  for  ready  use.  In 
that  sense,  they  would  be  similar  to  other  existing  checklists  prepared  for 
the  Army  armor  community.  However,  the  intent  of  the  Ml  crew  procedure  guides 
developed  under  this  contract  was  for  them  to  go  into  more  detail  than  exist¬ 
ing  checklists,  yet  at  the  same  time,  remain  easy  to  use  by  crewmembers. 

Two  goals  were  established  for  the  procedure  guides.  These  goals  were  as 
follows: 

1.  Provide  to  each  crewmember  a  convenient,  accurate,  and  comprehensive 
document  which  identifies  his  tasks,  and  task  procedures,  required 
for  preparing  the  tank  for  combat,  securing  the  tank,  and  performing 
various  activities  during  operation.  For  example,  the  procedure 
guide  would  present  to  the  gunner  the  procedures  involved  in  zeroing 
the  main  gun.  A  portion  of  this  procedure  is  illustrated  in 
Figure  1. 

2.  Support  initial  training  for  new  crewmembers.  For  example,  rather 
than  require  the  new  crewmember  to  read  a  complex  and  lengthy  state¬ 
ment  of  a  procedure  within  the  Operator's  Technical  Manual,  the  crew¬ 
member  could  instead  use  the  procedure  guides  as  simplified,  although 
complete,  versions  of  the  Technical  Manual. 

The  first  effort  in  preparing  the  crew  procedure  guides  was  to  identify 
those  tasks  which  would  be  included.  Although  the  Ml  Operator's  Technical 
Manual  and  various  armor  checklists  were  reviewed,  the  final  set  of  tasks 
selected  for  inclusion  in  the  guides  were  based  upon  crew  requirements  for 
setting  up  the  tank  for  combat  and  securing  the  tank. 

Many  of  the  more  complex  tasks  were  not  readily  adaptable  to  the  check¬ 
list  format  most  commonly  seen,  which  simply  list  steps  of  a  task.  This  was 
due  to  the  large  number  of  decisions  that  the  crewmember  is  required  to  make 
during  task  performance.  For  example,  the  task,  zero  the  main  gun,  contains 
16  potential  decision  points  within  the  more  than  100  procedural  steps.  To 
overcome  this  problem,  an  "algorithm"  type  checklist  which  would  incorporate 
those  decisions  was  developed.  A  set  of  algorithm  characteristics  (guide¬ 
lines)  was  established  prior  to  actual  material  development  in  order  to  ensure 
uniformity  of  preparation  activities.  These  characteristics  are  as  follows: 

•  Algorithms  will  present  clear  and  concise  procedures  required  for  suc¬ 
cessful  task  performance. 
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Figure  1.  Portion  of  ZERO  THE  MAIN  GUN  Procedures 
Included  In  the  Ml  Gunner  Procedure  Guides 
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•  Information  included  in  the  procedures  will  be  restricted  to  only  that 
which  is  necessary  to  perform  the  task. 

•  Language  used  in  the  procedure  steps  will  be  unambiguous  and  at  a  level 
appropriate  for  the  users. 

•  Algorithms  will  make  use  of  symbology  when  possible.  Original  symbology 
new  to  system  operators  will  be  defined  prior  to  presentation  in  the 
procedure. 

•  Notes/cautions/warnings  which  impact  task  performance,  safety,  or  system 
integrity  will  be  identified  at  appropriate  places  within  the 
procedures. 

•  All  decision  points  occurring  during  task  performance  will  be  identified. 
At  these  decision  points  the  user  will  be  asked  a  question.  Based  upon 
the  user's  answer  (formulated  internally)  the  appropriate  succeeding 
steps  will  be  identified.  This  branching  technique  will  require  that: 

-  all  decision  points  points  occuring  in  the  procedure  must  be 
identified. 

-  all  possible  alternative  actions/procedures  be  identified  and 
detailed. 

•  Each  algorithm  will  be  presented  independently  of  others  --  that  is,  each 
will  begin  on  a  separate  page  in  the  procedure  guides. 

•  Each  algorithm  will  possess  obvious  start  and  finish  points. 

•  Duplication  of  any  "common"  sub-procedures  will  be  avoided.  For  those 
sub-procedures  found  in  a  task,  a  separate  algorithm  will  be  developed 
for  that  sub-procedure.  This  will  avoid  unnecessarily  lengthly  and 
repetitive  procedures. 

•  Necessary  pictures  or  illustrations  will  be  included  in  each  procedure 
guide. 

•  Each  procedure  guide  will  contain  a  table  of  contents  which  will  allow 
the  user  to  rapidly  locate  the  desired  procedure  (task). 

•  The  physical  dimensions  of  the  procedure  guides  should  be  tailored  to 
their  intended  use  and  environment.  That  is,  procedure  guide  size  should 
take  into  account  space  required  and  available  for  use,  storage  require¬ 
ments,  and  frequency  of  anticipated  or  required  use. 

The  resulting  algorithms  are  very  similar  to  Job  Performance  Aids  in  that 
they  account  for  most  (if  not  all)  of  the  unique  occurrences  within  a  task. 
Depending  upon  the  decision  to  be  made,  the  user  is  directed  to  alternate  pro¬ 
cedures.  With  the  algorithm  technique  in  mind,  a  set  of  tasks  for  each  crew 
position  was  established  which  would  compose  the  crew  procedure  guides. 
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The  first  research  activity  involved  in  preparing  the  guides  was  to 
become  familiar  with  each  of  the  tasks  identified  for  inclusion.  This  process 
began  via  a  review  of  the  Ml  Operator's  Technical  Manual  (TM  9-2350-255-10) 
and  other  available  Ml  training  materials.  With  this  task  related  knowledge, 
developers  traveled  to  Fort  Knox,  Kentucky,  for  on-site  tank  inspection  and 
familiarization.  In  addition,  developers  reviewed  each  of  the  tasks  with 
Subject  Matter  Experts  (SMEs).  The  purpose  of  this  review  was  to  identify 
those  cues  and  responses  involved  in  task  performance  and  to  check  the  accu¬ 
racy  of  the  Operator's  Technical  Manual  vis-a-vis  what  was  actually  done  on 
the  tank. 

Following  this  review,  an  initial  algorithm  was  developed  for  each  task. 
These  initials  algorithms  were  then  taken  to  Fort  Knox  for  further  review  by 
Ml  SMEs.  Based  on  the  results  of  this  second  review,  the  algorithms  were  mod¬ 
ified.  The  modifications  were  based  upon: 

•  Input  from  SMEs,  and 

•  Changes  to  the  Ml  Operator's  Technical  Manual.  (Allen  Corporation  was 
provided  with  three  updated  versions  of  the  Technical  Manual  during  the 
course  of  procedure  guides  development.  Each  updated  version  required 
modification  to  the  procedure  guides.) 

Four  procedure  guides  booklets  resulted  from  the  effort  --  one  for  each 
crewmember  on  the  tank.  A  total  of  sixty-four  tasks  are  presented  across 
these  booklets.  In  addition,  before,  during,  and  after  operations  preventive 
maintenance  checks  and  services  (PMCS)  activities  are  identified  in  each  crew¬ 
member's  procedure  guide  booklet  as  appropriate.  Each  task  within  the  book¬ 
lets  has  separate  pages  devoted  to  it.  Further,  each  set  of  procedures  is 
annotated  for  warnings,  cautions,  lights  that  are  activated/deactivated,  and 
decisions  which  must  be  made  during  task  performance.  Tables  1  though  4  pre¬ 
sent  listings  of  all  tasks  included  in  the  Driver,  Loader,  Gunner,  and  Tank 
Commander  Procedure  Guides  respectively.  The  final  booklets  were  typed  into 
an  appropriate  reduction  format  in  order  to  allow  each  page  to  be  inserted 
into  plastic  jackets  of  pocket-size  ring  binders.  Although  formal  evaluations 
of  the  procedure  guides  were  conducted,  Allen  Corporation  was  not  involved  in 
those  evaluations.  Thus,  results  of  those  evaluations  are  not  presented  in 
this  document. 

A  sample  of  the  finished  Ml  crew  procedure  guides,  in  the  form  delivered 
to  ARI,  is  presented  in  Appendix  A  to  this  report. 

SUSTAINMENT  TRAINING  MATERIALS 

The  primary  focus  of  the  sustainment  training  materials  development  was 
on  the  maintenance  of  skills.  Thus,  an  assumption  was  made  that  Ml  crew  per¬ 
sonnel  had  well -developed  skills  related  to  various  tank  tasks.  The  purpose 
of  the  sustainment  materials  was  to  provide  review  and  enrichment  of  those 
skills. 

Approximately  forty-five  tasks  across  all  four  Ml  crew  positions  were 
initially  Identified  as  potential  candidates  for  which  sustainment  training 
materials  could  be  developed.  Many  of  these  tasks,  however,  were  the  same  as 
those  that  were  eventually  included  within  the  crew  procedure  guides.  As  a 
result,  the  Orignial  list  was  reduced  to  fourteen  in  number.  These  fourteen 
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Table  1.  Driver  Procedure  Guides 
ACTIVITIES 

Prepare  Station 
Enter  Station 
Power  Up  Hull  Systems 
Start  Engine 
After  Start  Checks 
Secure  Station 
Shut  Down  Engine 
Power  Down  Hul 1  Systems 
Exit  Tank 

Operate/Secure  Gas  Particulate  Filter 
Before  Operations  PMCS 
During  Operations  PMCS 
After  Operations  PMCS 


Table  2.  Loader  Procedure  Guides 
ACTIVITIES 

Prepare  Station 

Install  Weapon 

Enter  Station 

Power  Up  Station 

Secure  Station 

Power  Down  Station 

Remove  the  M240  Machinegun 

Unload  (Clear)  Main  Gun 

Manually  Extract  a  Main  Gun  Round 

Clear  the  M240  Machinegun 

Operate/Secure  Gas  Particulate  Filter 

Before  Operations  PMCS 

After  Operations  PMCS 


Table  3.  Gunner  Procedure  Guides 
ACTIVITIES 


Prepare  Station 
Enter  Station 

Install  Coaxial  Mactiinegun 

Power  Up  Station 

Perform  GPS  Functional  Check 

Perform  GPS  Adjustments 

Perform  Computer  Data  Ch.i.x 

Perform  TIS  Checkout 

Perform  GAS  Adjustments 

Perform  Computer  Self  Test 

Test  Fire  Control  System 

Perform  Lead  System  Check 

Perform  Firing  Circuits  Check 

Perform  Crosswind  Circuits  Check 

Prepare  to  Fire  Checks 

Update  Muzzle  Reference  Sensor 

Manual  Inputs  to  Automatic  Fire  Control  Data 

Manual  Inputs  to  Fire  Control  Data 

Zero  Coaxial  Machinegun 

Bores ight  the  Main  Gun 

Zero  the  Main  Gun 

Secure  Station 

Remove  Coaxial  Machinegun 

Power  Down  Station 

Clear  Coaxial  Machinegun 

Operate/Secure  Gas  Particulate  Filter 

Before  Operations  PMCS 

After  Operations  PMCS 
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Table  4.  Tank  Commander  Procedure  Guides 
ACTIVITIES 

Prepare  Station 

Enter  Station 

Power  Up  Station/Turret 

Install  Weapon  -  Cal  .50 

Install  Weapon  -  M240 

Prepare  to  Fire  Checks 

Boresight  the  Cal  .50 

Zero  the  Cal  .50 

Secure  Station 

Remove  Weapon  -  Cal  .50 

Remove  Weapon  -  M240 

Secure  Station  and  Turret 

Power  Down  Station  and  Turret 

Clear  the  Cal  .50 

Set  Headspace  and  Timing  -  Cal  .50 
Clear  the  M240 

Operate/Secure  Gas  Particulate  Filter 
Before  Operations  PMCS 

Master  Check-Off  List  -  Before  Operations  PMCS 
Master  Check-Off  List  -  During  Operations  PMCS 
Master  Check-Off  List  -  After  Operations  PMCS 


tasks,  listed  below,  were  selected  as  they  were  considered  to  be  complex  and 
thus,  candidates  for  sustainment  training. 

•  Issue  Fire  Commands 

•  Most  Dangerous  Threat  Identification 

•  Range  to  Target 

•  Machinegun  Fire  Techniques 

•  Multiple  Bar  Return 

•  Degraded  Gunnery  Modes 

•  Select  Routes 

•  Evades  Missiles 

•  Identify  Hull-  and  Turret-Down  Positions 

•  Target  Tracking  (Automatic  and  Manual) 

•  Computer  Self  Test 

•  Computer  Data  Check 

•  Manual  Data  Inputs 

•  Manual  Data  Inputs  to  Automatic  Functions 

For  the  fourteen  selected  tasks,  an  array  of  potential  techniques  for 
training  was  developed.  These  techniques  were  considered  innovative  in 
nature,  and  ranged  from  simple  paper  and  pencil  activities  to  sophisticated 
approaches  involving  the  use  of  microprocessors.  The  following  is  a  brief 
description  of  each  training  technique,  or  media  identified. 

1.  Line  drawings/booklet  -  A  booklet  presenting  a  number  of  line  draw¬ 
ings  of  various  battlefield  scenarios.  Each  scenario  would  be  accom¬ 
panied  with  a  written  problem  to  be  solved.  The  correct  answer  to 
the  problem  would  be  found  on  a  separate  page  within  the  booklet. 

2.  Photos/booklet  -  A  booklet  similar  to  (1)  above,  but  presenting 
photos  instead  of  line  drawings.  The  photos  would  permit  representa¬ 
tion  of  visual  components  in  actual  scale  and  with  correct  relation¬ 
ships  between  objects. 

3.  Slides/viewer/booklet  -  Similar  to  (1)  above  except  visual  represen¬ 
tations  would  be  on  a  slide  and  would  be  placed  in  a  hand-held  viewer 
and  held  to  the  eyes  for  viewing.  This  media  would  permit  control  of 
the  visual  angle  subtended  as  well  as  providing  an  increased  simula¬ 
tion  of  depth.  In  essence,  what  is  seen  with  this  media  would  be  a 
direct  replica  (in  almost  all  respects)  of  the  real  world. 

4.  Slides/timed  viewer /book let  -  Similar  to  (3)  above  except  employing  a 
slide  viewer  with  a  timing  apparatus.  Thus,  the  time  involved  in 
completing  a  task  could  be  controlled. 

5.  Motion  picture/device/booklet  -  A  portable  device  capable  of  depict¬ 
ing  motion  involving  realistic  battlefield  scenarios.  Problems  and 
solutions  could  be  presented  via  an  accompanying  booklet.  The  device 
would  be  held  to  the  eyes  enabling  control  of  the  visual  angle 
subtended. 
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6.  Flashcards/realistic  pictorial  -  A  set  of  flashcards  presenting  a 
pictorial  scenario  as  well  as  a  written  problem.  As  in  all  flash- 
cards,  problem  solutions  would  be  presented  on  the  back  of  the 
cards. 

7.  FI ashcards/non-real i Stic  pictorial  -  A  set  of  flashcards  presenting  a 
non-real istic  scenario.  The  scenario  would  be  akin  to  a  football 
play  diagram  which  would  include  threat  and  friendly  forces,  environ¬ 
mental  conditions,  ranges,  and  other  required  cues  as  well  as  a  writ¬ 
ten  problem.  The  cards  would  focus  on  the  development  of  strategies 
rather  than  visual  perceptions. 

8.  Pictures/non-real istic  overlays/booklet  -  A  set  of  environmental  pic¬ 
tures  with  transparent  overlays  presenting  non-realistic  scenarios 
akin  to  football  play  diagrams.  The  overlays  would  present  threat 
and  friendly  forces,  ranges,  and  so  forth  and  would  result  in  the 
development  of  strategies.  The  booklet  would  present  problems  and 
provide  solutions. 

9.  Workbook  -  A  written  booklet  presenting  problems  to  be  completed. 

10.  Mockup  computer  control  panel  (CCP)  with  microprocessor/coded  acetate 
overlays  -  A  device  which  would  permit  manipulation  of  a  surface  sim¬ 
ilar  to  that  of  the  CCP.  The  coded  acetate  overlays  would  include 
written  data  inputs  such  as  barometric  pressure  and  ammunition  tem¬ 
perature.  Use  of  the  device  would  permit  personnel  to  repetitively 
run  through  various  CCP  tasks  and  receive  feedback  on  their  perform¬ 
ance.  Control  of  the  device  would  be  via  the  coded  acetate  overlays 
permitting  various  situations  and  problems  to  be  developed. 

Following  identification  and  definition  of  the  potential  media  types,  a 
draft  media  model  was  developed  to  determine  the  optimal  media  type  for  each 
of  the  fourteen  tasks.  Figure  2  illustrates  the  "matching"  of  the  various 
media  types  to  each  candidate  task. 

Upon  review  of  the  model,  many  of  the  media  types  were  deemed  too  costly 
to  develop  under  the  existing  contract.  Therefore,  it  was  decided  that  only 
the  simpler  paper  and  pencil  techniques  for  training  would  be  employed  for 
this  research  effort.  In  addition,  it  was  believed  that  the  paper  and  pencil 
approach  would  be  more  suitable  for  use  both  within  and  without  the  tank. 

This  review  also  limited  the  number  of  tasks  to  be  trained  to  a  total  of  five. 
These  five  tasks  are: 

1.  Issue  Fire  Commands, 

2.  Degraded  Mode  Gunnery, 

3.  Oealing  with  Multiple  Laser  Returns, 

4.  Target  Handoff,  and 

5.  Target  Tracking  and  Leading. 
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5.  Motion  Picture  Device  Booklet  10.  Mock-up  CCP/Microprocessor/Coded  Acetate  Overlay 
**Numer ics  located  in  matrix  cells  represent  first  and  second  best  media  choices. 


Task  5  above,  was  identified  as  a  candidate  for  sustainment  training  after 
review  of  the  media  model  and  final  task  selection. 

The  training  approaches  applied  to  these  tasks  were  of  two  types.  First 
are  what  were  termed  "scenarios".  The  tasks  selected  for  training  using  the 
scenario  approach  include  issue  fire  commands,  degraded  mode  gunnery,  and 
dealing  with  multiple  laser  returns.  The  se  ond  are  what  were  termed  “field 
exercises".  Field  exercises  were  developed  to  train  the  target  handoff,  and 
target  tracking  and  leading  tasks.  Each  of  these  training  approaches  is 
briefly  described  below. 

Scenarios 

The  scenarios  were  designed  as  a  new  and  unique  way  of  presenting  combat 
situations  to  the  crewmembers.  These  situations  are  presented  via  a  pictorial 
representation  of  the  battlefield  situations  and  a  brief  description  of  the 
battlefield  situation.  In  addition,  a  description  of  the  Ml  tank  system  sta¬ 
tus  and/or  malfunction  indications  is  included.  Following  the  situation 
description  is  a  problem  which  must  be  solved  for  the  given  situation.  The 
crewmember  must  decide  on  the  appropriate  next  action  by  choosing  from  an 
array  of  possible  answers  or  constructing  a  unique  answer.  All  of  the  above 
information  is  confined  to  a  one  page  scenario.  An  explanation  of  the  correct 
answer  to  the  problem  is  presented  on  the  following  page.  Figure  3  presents  a 
typical  degraded  mode  gunnery  scenario. 

The  scenarios  were  evaluated  during  the  two  separate  field  evaluations. 
Because  the  content  of  the  scenarios  changed  based  on  the  lessons  learned  dur¬ 
ing  the  first  evaluation,  a  detailed  description  of  the  scenario  contents  is 
reserved  for  Section  III,  Field  Evaluation  1,  and  Section  IV,  Field  Evalua¬ 
tion  2  of  this  report.  It  should  be  mentioned  at  this  time  that  no  initial 
learning  material  was  presented  during  Field  Evaluation  1.  That  is,  the  first 
training  materials  encountered  by  the  crewmembers  were  the  scenarios  them¬ 
selves.  However,  Field  Evaluation  1  results  indicated  that  many  crewmembers 
lack  the  basic  knowledge  related  to  fire  commands  and  degraded  mode  gunnery. 
Thus,  for  Field  Evaluation  2,  detailed  knowledge  booklets  were  developed  and 
presented  to  the  crewmen  prior  to  their  beginning  the  scenarios.  These  know¬ 
ledge  booklets,  described  in  detail  in  Section  IV,  provided  the  crewmen  with 
basic  fire  command  and  degraded  mode  gunnery  skills  needed  to  use  the  scenar¬ 
ios  in  a  more  meaningful  manner.  A  sample  of  the  knowledge  and  scenarios 
booklets,  in  the  form  used  during  Field  Evaluation  2,  is  presented  in 
Appendix  B. 

Field  Exercises 

Training  materials  for  the  target  handoff  and  target  tracking/leading 
tasks  were  presented  in  the  form  of  field  exercises.  The  exercises  were 
designed  to  give  the  crewmembers  actual  hands-on  practice  for  these  tasks. 

For  each  task,  the  training  materials  describe  how  the  exercise  is  to  be  set 
up  and  prepared.  Each  of  the  exercises'  set  up  instructions  are  designed  to 
be  simple  and  capable  of  being  performed  by  the  crew  without  the  assistance  of 
additional  trainers/personnel .  The  exercises  are  tailored  for  use  on  a  small 
maneuvering  area,  approximately  300  feet  by  600  feet.  Once  set  up,  detailed 
instructions  for  conducting  the  exercises  are  presented  along  with  easy-to-use 
performance  recording  sheets.  Finally,  each  exercise  booklet  presents  alter¬ 
native  methods  for  conducting  the  exercise.  These  alternative  methods  provide 
guidance  for  a  tank  crew  who  either  does  not  have  access  to  a  suitable 
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SCENARIO  37 
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THE  SITUATION 

•  Ml  is  positioned  next  to  an  old  building. 

•  You  see  a  HIND-D  chopper  directly  in  front  of  you  hovering  about 
100  meters  above  the  ground. 

•  You  are  undetected. 

•  F  in  GPS  and  range  shows  flashing  "0000". 

•  You  run  a  self  test  and  the  laser  is  the  only  failure 
found. 

•  You  cancel  the  RANGE  input. 

What  is  the  next  thing  to  do  before  you  can  engage  the 
chopper? 


Figure  3.  Typical  Degraded 
Mode  Gunnery  Scenario 


(Continued) 


SCENARIO  37  ANSWER 


The  correct  answer  is:  Estimate  range  to 

target. 

When  the  laser  fails  you: 

•  Estimate  range  to  target. 

•  If  target  is  in  battlesight  range, 
use  GPS  battlesight. 

•  If  target  is  beyond  battlesight 
range,  use  GAS  precision  (esti¬ 
mated  range). 

•  Engage  the  target  and  apply  BOT. 


The  important  thing  to  remember  is  that  you 
must  first  estimate  the  range  to  the  target. 
You  then  can  decide  if  GPS  battlesight  or 
GAS  with  estimated  range  will  be  used  to 
engage  the  target. 


Figure  3.  Typical  Degraded 
Mode  Gunnery  Scenario 
(continued) 


maneuvering  (open)  area  or  wishes  to  make  the  exercises  more  challenging  ana 
difficult. 

Exercise  material  requirements,  with  the  exception  of  the  Ml  tank,  are 
such  that  they  can  be  easily  obtained,  maintained,  and  stored  by  an  individual 
tank  crew  or  platoon.  Materials  required  for  the  basic  field  exercises 
include: 

•  Six  target  illustrations  drawn  on  posterboard-type  material  having  the 
approximate  dimensions  of  2  by  2-1/2  feet, 

•  Five  target  frames  approximately  4  feet  high  designed  to  "stand"  the  tar¬ 
gets  at  predefined  ranges, 

•  One  target  frame  capable  of  being  carried  by  a  crewmember, 

•  Several  small  marker  stakes,  and 

•  One  stopwatch  and  pen/pencil. 

The  size  and  shape  of  the  target  illustrations  are  such  that  they  approximate 
realistic  target  characteristics  at  the  appropriate  ranges. 

The  nature  of  the  exercises  is  such  that  they  can  be  conducted  with  a 
minimum  of  preparation  time.  Thus,  they  are  well  suited  as  an  "in-the-cracks" 
training  aid.  A  sample  of  the  field  exercises,  in  their  final  form,  is  pre¬ 
sented  in  Appendix  C  to  this  report. 

Preparation  and  Evaluation 

During  the  period  of  May  1981  through  November  1981,  the  sustainment 
training  materials  were  developed.  Most  of  the  subject  matter  expertise  input 
was  provided  by  the  Ml  New  Equipment  Training  (NET)  Team,  Fort  Knox,  Kentucky. 
A  sample  of  the  sustainment  training  materials  was  prepared  for  use  at  Fort 
Hood,  Texas  during  the  month  of  November  1981.  This  initial  evaluation  of  the 
sustainment  materials  was  conducted  by  Allen  Corporation  personnel.  Based 
upon  the  results  of  the  evaluation,  the  sustainment  training  materials  were 
revised  and  expanded. 

The  finished  sustainment  training  materials  were  evaluated  during  Febru¬ 
ary  1982.  This  evaluation,  unlike  the  initial  evaluation,  was  conducted 
directly  by  the  tank  commanders,  with  Allen  Corporation  personnel  providing 
only  support  functions.  Following  the  final  evaluation,  Allen  Corporation 
modified  each  of  the  scenario  booklets  and  exercises  in  respect  to  comments 
from  Ml  personnel  at  Fort  Hood.  In  preparation  for  final  printing,  these  mod¬ 
ifications  have  been  discussed  with  various  Fort  Knox  SMEs  in  order  to  assure 
that  the  final  sustainment  materials  possess  content  accuracy. 

A  detailed  discussion  of  the  procedures  employed,  and  results  obtained, 
from  Field  Evaluations  1  and  2  are  presented  in  Section  III  and  IV 
respectively. 


SECTION  III 


FIELD  EVALUATION  1 


This  field  evaluation  was  conducted  during  November  of  1981  and  lasted 
one  week.  The  evaluation  took  place  at  Fort  Hood,  Texas  and  utilized  nine  Ml 
tank  crews.  The  purpose  of  the  field  evaluation  was  to:  1)  assess  accept- 
aoility  of  the  sustainment  training  materials  format,  and  2)  verify  content 
accuracy  of  the  materials. 

MATERIALS 

Sustainment  training  materials  evaluated  during  this  pilot  test  included 
both  the  field  exercises  and  samples  of  the  scenarios.  In  addition,  support¬ 
ing  materials  were  developed  and  employed.  The  contents  of  each  of  these 
materials  is  briefly  described  below. 

Scenarios 

The  scenario  samples  evaluated  during  this  pilot  test  included  scenarios 
for  both  Issue  Fire  Commands  and  Degraded  Mode  Gunnery.  For  both  of  these 
categories,  several  series  of  scenarios  were  developed.  Each  series  consisted 
of  scenarios  dealing  with  the  same  "subtopic".  The  following  is  a  list  of  the 
series  including  the  number  of  scenarios  within  each. 

Issue  Fire  Commands 


Series  1  -  Proper  Sequence  of  Fire  Command  Elements  (4  scenarios) 
Series  2  -  Proper  Weapon /Ammunition  for  Target  (4  scenarios) 
Series  3  -  Identify  Most  Dangerous  Target  (10  scenarios) 

Series  4  -  Crew  Engagement  Responses  (6  scenarios) 

Series  5  -  Combat  Situations  (17  scenarios) 


Degraded  Mode  Gunnery 

Series  1  -  Before  Operations  Checks  (9  scenarios) 

Series  2  -  Identify  Degraded  Modes  (6  scenarios) 

Series  3  -  Respond  to  Degraded  Modes  (7  scenarios) 

Series  4  -  Identify  and  Respond  to  Degraded  Modes  (15  scenarios) 

Each  scenario  series  began  with  directions  for  using  the  series.  The  scenar¬ 
ios  within  each  series  contained  those  scenario  characteristics  described  in 
Section  II.  Located  at  the  back  of  each  series  were  answer  sheets  on  which 
the  user  could  record  his  responses. 

Field  Exercises 

Two  field  exercises  were  tested  during  this  evaluation.  These  exercises 
were  Target  Handoff,  and  Target  Tracking  and  Leading.  The  contents  of  the 
field  exercise  booklets  were  discussed  in  the  preceeding  section. 
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Supporting  Materials 

In  addition  to  the  sustainment  training  materials  described  above,  sup¬ 
plementary  data  collection  materials  were  developed  for  the  field  evaluation. 
These  materials  include: 

•  Pre-  and  post-tests  for  the  fire  command  materials.  The  pre-test  and 
post-test  each  consisted  of  three  scenarios  representati ve  of  the  prob¬ 
lems  presented  in  the  fire  command  scenario  series.  The  crewmembers  were 
required  to  construct  an  answer  for  the  problems  presented  in  the  scenar¬ 
ios.  Identical  forms  were  not  employed.  However,  the  pre-  and  post¬ 
tests  were  designed  to  be  equivalent  in  terms  of  content  and  difficulty. 

•  Pre-  and  post-tests  for  the  degraded  mode  gunnery  materials.  The  pre¬ 
test  and  post-test  were  identical  forms.  Each  consisted  of  eight  brief 
multiple  choice  test  items.  The  test  items  were  representative  of  the 
problems  presented  in  the  degraded  mode  gunnery  scenarios. 

•  Experience  questionnaire.  The  questionnaires  were  designed  to  obtain 
crewmen  data  such  as  length  in  service,  present  pay  grade,  previous  Ml 
tank  experience,  and  various  other  demographic  information.  Only  one 
form  of  the  questionnaire  was  developed. 

•  Fire  command  materials  evaluation  form.  The  evaluation  form  was  devel¬ 
oped  to  elicit  crewmembers'  perception  of,  and  attitude  toward,  the  fire 
command  scenarios  via  numerous  multiple  choice  questionnaire  items. 

•  Degraded  mode  gunnery  evaluation  form.  The  evaluation  form  employed  to 
identify  the  crewmembers'  perception  of,  and  attitude  toward,  the 
degraded  mode  gunnery  scenarios  was  identical  to  the  fire  command  materi¬ 
als  evaluation  form. 

•  Target  handoff  exercise  evaluation  form.  This  form  consisted  of  free- 
response  and  multiple  choice  questionnaire  items  designed  to  identify  the 
crewmembers'  attitude  toward  the  target  handoff  exercise. 

•  Target  tracking  and  leading  exercise  evaluation  form.  This  form,  like 
that  employed  for  the  target  handoff  exercise,  consisted  of  free-response 
and  multiple  choice  questionnaire  items  designed  to  elicit  the  crewmem¬ 
bers'  attitude  toward  the  target  tracking  and  leading  exercise. 

The  manner  in  which  each  of  these  materials  was  employed  is  discussed  in  the 
following  paragraphs. 

PROCEDURES 

As  mentioned  above,  nine  Ml  tank  crews  participated  in  this  evaluation. 
Each  crew's  level  of  participation  was  four  hours.  Thus  a  total  of  two  crews 
evaluated  the  training  materials  and  field  exercises  in  one  eight-hour  day. 
Further,  each  crew's  four-hour  participation  was  divided  into  two  two-hour 
sessions: 
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•  Session  1  -  Evaluation  of  scenarios, 

•  Session  2  -  Evaluation  of  field  exercises. 

Since  all  crews  participated  in  approximately  the  same  manner,  the  following 
paragraphs  present  the  field  evaluation  procedures  for  one  "typical"  crew. 

Session  1 

Session  1  began  with  an  overview  of  the  field  evaluation  presented  by 
Allen  Corporation  personnel.  The  overview  addressed  such  topics  as  purpose, 
duration  and  activities  of  the  evaluation,  and  each  crewmember's  role  in  the 
evaluation.  In  addition,  a  brief  description  of  the  materials  was  presented. 

Following  the  overview,  each  crewmember  was  administered  an  experience 
questionnaire.  After  the  questionnaires  were  administered,  the  crew  was 
divided  into  two  groups  of  two  people  each.  One  group  (Group  1)  was  assigned 
to  work  on  the  degraded  mode  gunnery  scenario  series  while  the  second  group 
(Group  2)  was  assigned  to  work  on  the  fire  command  scenario  series.  Prior  to 
beginning  work  on  the  scenarios,  appropriate  pre-tests  (degraded  mode  gunnery 
or  fire  command)  were  administered  to  all  crewmembers.  Group  1  always  con¬ 
sisted  of  the  gunner  and  either  the  driver  or  loader.  Group  2  always  con¬ 
sisted  of  the  tank  commander  and  driver  or  loader,  whichever  was  not  in 
Group  1.  The  Allen  Corporation  representati ve  was  present  at  all  times  and 
was  available  to  answer  any  questions  regarding  scenario  instructions  or  con¬ 
tent.  The  Ml  crewmembers  were  asked  to  not  only  complete  the  appropriate 
series  of  scenarios,  but  also  to  identify  any  areas  of  questionable  content 
accuracy.  Upon  completion  of  the  scenario  series,  crewmembers  were  given  a 
post-test  appropriate  to  the  specific  group  to  which  they  were  assigned.  Due 
to  evaluation  time  limitations.  Group  1  did  not  evaluate  the  fire  command 
material,  nor  did  Group  2  evaluate  any  of  the  degraded  mode  gunnery  material. 

At  the  end  of  Session  1,  the  post-tests  were  collected  and  scenario  eval¬ 
uation  forms  were  distributed  for  completion.  Group  1  received  the  degraded 
mode  gunnery  evaluation  form  while  Group  2  completed  the  fire  command  evalua¬ 
tion  form.  In  most  cases,  both  groups  were  able  to  complete  all  of  their 
respective  scenarios  within  the  Session  1  time  limitation.  There  were  a  few 
instances,  however,  where  a  crewmember  was  unable  to  complete  all  of  his  mate¬ 
rials.  Since  the  purpose  of  the  evaluation  was  not  to  obtain  detailed  per¬ 
formance  scores  of  individuals  for  each  scenario  series,  no  requirement  was 
placed  on  the  crewmember  to  spend  extra  time  completing  the  materials.  It  was 
felt  that  all  crewmembers  who  began  working  on  the  scenario  series  were  able 
to  complete  enough  material  to  allow  them  to  evaluate  the  materials  in  a  mean¬ 
ingful  manner. 

Session  2 

Session  2,  evaluation  of  the  field  exercises,  required  employing  an  Ml 
tank  in  a  small  maneuvering  area.  Thus,  at  the  beginning  of  this  session  the 
crew  would  move  the  tank  from  the  Fort  Hood  Ml  motor  pool  to  the  maneuvering 
area  located  a  short  distance  from  the  motor  pool.  The  crew  was  then  given 
the  Target  Handoff  and  Target  Tracking  and  Leading  Exercise  booklets. 

Although  the  booklets  contained  instructions  for  setting  up  the  exercises 
(building  target  frames,  placing  targets,  etc.),  Allen  Corporation  personnel 
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performed  all  exercise  set-up  activities  prior  to  each  crew's  arrival  in  an 
effort  to  make  the  best  use  of  time  available. 

After  the  crew  reviewed  the  exercise  booklets,  the  TC  was  instructed  to 
take  the  lead  in  his  crew's  conduct  of  the  exercises.  The  Allen  Corporation 
representative  remained  either  on  or  near  the  tank  but  did  not  intervene 
unless  queried  by  the  TC. 

The  crew  began  by  first  conducting  the  Target  Handoff  Exercise.  Although 
this  exercise  constitutes  only  TC/gunner  interaction,  the  TC  attempted  to  have 
all  of  his  crew  (gunner,  loader,  and  driver)  take  turns  as  the  "gunner"  as 
time  permitted.  The  TC  not  only  led  this  exercise,  but  was  also  responsible 
for  recording  each  crewmember's  performance  during  the  exercise. 

Upon  completion  of  the  Target  Handoff  Exercise,  the  TC  would  have  the 
driver  move  the  tank  to  the  position  required  for  the  Target  Tracking  and 
Leading  Exercise.  Once  again,  the  TC  led  this  exercise  (without  any  unneces¬ 
sary  interference  from  the  Allen  Corporation  representative)  and  attempted  to 
have  each  of  his  crewmembers  take  turns  as  the  "gunner"  as  time  permitted. 

The  TC  scored  each  crewmember's  performance  on  this  exercise  as  well. 

When  both  the  Target  Handoff  and  Target  Tracking  and  Leading  exercises 
were  completed,  evaluation  forms  were  administered.  Those  crewmembers 
(including  the  TC)  who  participated  in  the  first  exercise  were  each  given  a 
Target  Handoff  Exercise  Evaluation  form  to  complete.  Those  crewmembers  who 
participated  in  the  second  exercise  were  each  given  a  Target  Tracking  and 
Leading  Exercise  Evaluation  form  to  complete.  After  all  evaluation  forms  were 
filled  out  by  the  appropriate  crewmembers,  the  crew  returned  the  Ml  to  the 
motor  pool,  thus  ending  their  role  in  the  evaluation.  The  intention  was  to 
have  all  crewmembers  participate  in  both  exercises.  There  were  some 
instances,  however,  when  this  was  not  possible.  The  reasons  for  these  devia¬ 
tions  are  discussed  below. 

Special  Conditions 

During  the  course  of  Field  Evaluation  1,  several  unexpected  conditions 
were  encountered  which  warrant  mentioning  at  this  time.  These  conditions 
include  the  testing  environment,  personnel  availability,  and  equipment 
availability. 

Testing  Environment.  Although  not  by  design,  the  conditions  under  which 
the  scenario  evaluation  took  place  varied  from  crew  to  crew,  and  were  not 
under  the  control  of  the  researchers.  That  is,  there  was  no  classroom, 
ready-room,  etc.,  designated  for  use  during  the  evaluation.  As  a  result,  some 
crews  completed  the  scenarios  standing  by  their  tank,  while  other  crews  used 
the  floor  of  a  maintenance  area  or  even  the  back  of  a  truck.  It  was  not  until 
the  last  two  days  of  the  evaluation  that  a  room  above  the  maintenance  area  was 
made  available  for  use  by  the  crews.  This  room,  however,  was  still  much  less 
than  satisfactory  for  evaluation  purposes  as  it  did  not  contain  chairs  for  the 
crewmembers,  nor  was  it  capable  of  being  heated  to  a  comfortable  temperature. 
It  is  obvious  that  such  conditions  would  detract  from  motivation  and  crew 
cooperation. 

Personnel  Availability.  As  mentioned  previously,  a  total  of  nine  Ml  tank 
crews  were  scheduled  to  participate  in  the  evaluation.  However,  it  was  not 
uncommon  to  find  that  one  crewmember  was  absent  or  that  one  crewmember  could 
participate  for  only  some  portion  of  that  crew's  evaluation.  As  a  result,  the 


20 


number  of  crewmembers  (sample  size)  participating  in  the  various  evaluation 
activities  was  distributed  unequally. 

Equipment  Availability.  Crew  access  to  Ml  tanks  was  often  hampered. 
Reasons  for  this  non-availability  of  equipment  included:  not  having  keys  to 
unlock  the  tank,  not  having  permission  to  use  the  tank,  not  knowing  which  tank 
could  be  used,  and  not  having  keys  to  the  motor  pool  gate  which  was  the  only 
tank  exit  from  the  motor  pool  area. 

The  purpose  of  mentioning  these  special  conditions  at  this  time  is  two¬ 
fold.  First,  it  gives  the  reader  a  better  understanding  of  what  can  be 
expected  during  a  typical  field  evaluation.  Secondly,  it  provides  an  explana¬ 
tion  for  the  missing  "data  points"  which  the  reader  will  encounter  when 
reviewing  the  results  of  this  field  evaluation. 

RESULTS 

The  following  is  the  presentation  of  Field  Evaluation  1  results.  The 
results  cited  are  based  upon  several  data/ informat  ion  sources.  These  sources 
include: 

•  Experience  Questionnaires 

•  Fire  command  Pre-  and  Post-Tests 

•  Oegraded  Mode  Gunnery  Pre-  and  Post-Tests 

•Crew  Evaluations  of  the  Fire  Command  Materials 

•  Crew  Evaluations  of  the  Oegraded  Mode  Gunnery  Materials 

•  Target  Handoff  Exercise 

•Target  Tracking  and  Leading  Exercise 

•  Crew  Evaluations  of  the  Target  Handoff  Exercise 

•Crew  Evaluations  of  the  Target  Tracking  and  Leading  Exercise 

•Allen  Corporation  Personnel  Observations 

The  results  are  presented  in  four  primary  topic  areas.  These  areas  include: 
(1)  Subject  Experience;  (2)  Fire  command  Scenarios;  (3)  Degraded  Mode  Gunnery 
Scenarios;  and  (4)  Field  Exercises. 

Subject  Experience 

The  experience  history  of  the  crewmembers  participating  in  Field  Evalua¬ 
tion  1  is  summarized  in  Table  5.  As  seen  in  that  table,  major  differences  in 
subject  experience  exist  primarily  between  TCs  and  the  other  crewmembers.  TCs 
were  typically  older  than  their  tank  crewmembers  by  an  average  of  almost  six 
years.  In  addition,  their  length  in  the  service  and  experience  on  tanks  other 
than  the  Ml  was  much  greater  than  that  of  the  drivers,  loaders,  or  gunners. 

It  was  observed,  however,  that  some  experienced  TCs  were  somewhat  more  resist¬ 
ant  to  change  than  other  crewmembers.  That  is,  some  TCs  disagreed  with  some 
fire  command  and  degraded  mode  gunnery  material  content  because,  as  they  ver¬ 
bally  indicated,  it  was  not  the  way  they  did  things  on  the  "old"  tanks.  Fur¬ 
ther,  Allen  Corporation  personnel  observed  that  TCs,  in  general,  were  superior 
to  their  tank  crewmembers  in  terms  of  communication  skills  and  reading  abil¬ 
ity.  A  potential  result  of  this  subjective  observation  is  that  TCs  may  have 
been  able  to  complete  the  training  materials  more  easily  and  rapidly  than  were 
drivers,  loaders,  and  gunners.  (Note:  Data  presented  in  Table  5  resulted 
from  different  sample  sizes.  Some  items,  such  as  "Time  on  Other  Tanks,"  did 
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not  apply  to  some  crewmembers.  Other  items,  such  as  "Time  on  Ml"  were  either 
misinterpreted  or  inappropri ately  answered  by  some  crewmembers . ) 

Fire  Command  Scenarios 

The  objective  data  relating  to  the  training  effectiveness  of  the  fire 
command  materials  were  obtained  via  the  fire  command  pre-  and  post-tests.  As 
seen  in  Figure  4,  performance  on  the  post-test  (across  drivers,  loaders,  and 
TCs)  was  slightly  lower  than  pre-test  performance.  Although  this  difference 
was  not  found  to  be  statistically  significant,  it  is  felt  to  be  a  noteworthy 
result.  There  are  several  possible  explanations  for  the  decline  in  post-test 
performance.  Three  potential  explanations  are: 

1)  Pre-test  and  post-test  forms  were  designed  to  be  equivalent  in  diffi¬ 
culty  and  content.  It  is  possible  that  this  design  intent  was  not 
met  and  that  the  post-test  was  actually  more  difficult  than  the 
pre-test. 

2)  Subjects  did  not  possess  the  knowledge  "required"  to  deal  with  the 
fire  command  scenarios.  This  lack  of  "required  knowledge"  may  have 
resulted  in  confusion  as  opposed  to  learning. 

3)  Given  the  conditions  under  which  the  fire  command  materials  were 
evaluated  (discussed  previously),  subjects  may  have  been  experiencing 
fatigue  or  boredom  by  the  time  the  post-test  was  administered. 

It  is  interesting  to  note  that  decreased  performance  on  the  post-test  was 
somewhat  position  specific.  That  is,  performance  decreases,  although  not  sta¬ 
tistically  significant,  were  evidenced  only  with  drivers  and  loaders.  This  is 
shown  in  Figure  5.  TC  post-test  performance  did  not  decline,  but  rather, 
remained  relatively  constant  (and  statistically  insignificant).  Overall,  TCs 
performed  much  better  on  the  pre-  and  post-tests  than  did  drivers  and  loaders. 
This  fact  lends  itself  in  support  of  Explanation  2  above  --  that  subjects  did 
not  possess  sufficient  basic  fire  command  knowledge  for  learning  to  occur  sim¬ 
ply  by  practicing  the  scenarios. 

Although  drivers  and  loaders  performed  somewhat  poorly  on  the  fire  com¬ 
mands  pre-  and  post-tests,  researchers  observed  that  their  attitude  toward  the 
scenarios  remained  favorable.  Table  0-1  (in  Appendix  D)  presents  a  summary  of 
driver,  loader,  and  TC  responses  on  the  fire  command  scenarios  evaluation 
form.  Because  the  information  presented  in  that  table  is  relatively  straight¬ 
forward,  a  detailed  disucussion  of  each  question  and  associated  crew  responses 
is  not  deemed  necessary.  In  summary,  however,  most  of  the  respondents  indi¬ 
cated  that  the  scenarios  were  acceptable  in  terms  of  readability  and  complete¬ 
ness.  Further,  the  crewmen  generally  found  the  scenarios  interesting  and  felt 
that  the  material  is  very  useful  for  practice.  Although  less  than  half  of  the 
crewmembers  thought  they  had  learned  a  lot  by  doing  the  scenarios,  all  partic¬ 
ipants  indicated  that  they  would  use  the  scenarios  if  many  were  available. 

Degraded  Mode  Gunnery  Scenarios 

In  contrast  to  the  performance  data  obtained  from  the  fire  command  pre- 
and  post-tests,  average  degraded  mode  gunnery  post-test  score  (across  drivers, 
loaders,  and  gunners)  was  higher  than  the  average  pre-test  score  (see 
Figure  6).  These  identical  pre-  and  post-tests  displayed  a  mean  difference  of 
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Evaluation  1:  Results  of  Fire  Command  Pre-  and  Post-Tests. 
Percent  Correct  Across  Drivers,  Loaders,  and  TCs. 


48.3 


43.6 

N=15 

N=13 

Pre-  Post- 
Test  Test 

4 


r 


24 


Test  Test 
Driver 


Test  Test 
Loader 


Test  Test 
TC 


Evaluation 


Figure  5 

:  Results  of  Fire  Command  Pre-  and  Post-Tests 
Percent  Correct  By  Crew  Position. 
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Figure  6 


Evaluation  1:  Results  of  Degraded  Mode  Gunnery  Pre-  and  Post-Tests 
Percent  Correct  Across  Drivers,  Loaders,  and  Gunners. 


nearly  18  percent  wnicr  is  significant  beyond  tne  0.01  level  of  significance 
(t=3.038,  df=32).  As  seen  in  Figure  7,  the  higher  post-test  scores  were  not 
restricted  to  any  one  crew  position,  but  ratner  were  achieved  by  drivers, 
loaders,  ana  gunners.  Although  average  post-test  scores  were  not  signifi¬ 
cantly  ( statistically)  higher  than  pre-test  scores  for  any  of  these  groups, 
average  increases  in  test  performance  ranged  from  15.6  percent  for  gunners  to 
nearly  22  percent  for  drivers.  These  results,  together  with  those  presented 
in  Figure  6,  indicate  that  learning  may  have  indeed  occurred  as  a  result  of 
practicing  the  degraded  mode  gunnery  scenarios. 

As  was  the  case  with  the  fire  command  materials,  participants  responded 
favorably  to  the  degraded  mode  gunnery  scenarios.  The  results  of  the  drivers, 
loaders,  and  gunners  scenarios  evaluation  are  summarized  in  Table  D-2.  That 
table  indicates  that  although  some  respondents  found  the  scenarios  hard  to  do, 
nearly  all  felt  that  the  scenarios  would  be  a  useful  tool  for  practice  and 
that  they  did  learn  as  a  result  of  practicing  the  scenarios.  Not  all  crewmen 
responded  quite  so  favorably,  however.  In  particular,  one  gunner  found  the 
scenarios  boring  while  one  loader  indicated  that  he  learned  nothing  at  all  by 
doing  the  scenarios.  These  subjects  are  believed  to  be  exceptions,  however, 
and  their  reactions  should  not  be  used  to  describe  general  subject  attitude. 

Field  Exercises 

During  the  field  exercises,  crewmembers  were  observed  to  be  genuinely 
motivated  and  eager  to  participate.  Further,  many  of  the  drivers  and  loaders 
found  that  the  exercises  provided  them  with  unique  and  pleasant  experiences. 

Target  Handoff  Exercise.  A  total  of  five  drivers,  six  loaders,  and  five 
gunners  participated  as  the  "gunner"  during  the  Target  Handoff  Exercise.  Each 
participant  performed  sixteen  target  handoff s  (trials).  Data  collected  during 
this  exercise  are  presented  in  Figures  8  and  9.  Figure  8  shows  that  average 
target  handoff  time  was  relatively  constant  between  crew  positions.  Figure  9, 
however,  illustrates  that  gunners  achieved  somewhat  higher  levels  of  accuracy 
of  laying  on  the  tarnet  than  did  drivers  or  loaders.  Further,  it  should  be 
noted  that  complete  target  misses  were  very  low  for  each  of  the  crew  posi¬ 
tions.  Only  2.6  percent  of  all  targets  handoffs  resulted  in  target  misses  for 
drivers,  compared  with  2.1  percent  for  loaders.  Across  all  80  trails  per¬ 
formed  by  gunners,  no  target  misses  were  observed. 

Statistical  analyses  were  not  performed  using  data  from  the  Target  Hand¬ 
off  Exercise.  Reasons  for  not  performing  statist icil  tests  are  as  follows: 

•  The  crewmember  in  the  loader’s  position  was  >  sponsible  for  keeping  time 
using  a  stopwatch.  Although  instructions  werf  given  as  to  timekeeping 
procedures,  standardization  between  timekeepers  cannot  be  assessed. 

•  The  TC  was  responsible  for  scoring  accuracy  of  laying  on  target.  This 
scoring  is  somewhat  subjective  and  can  vary  among  TCs.  Thus,  scoring 
consistency  by  TCs  is  also  questionable. 

Again,  the  intent  of  evaluating  this  exercise  was  not  to  obtain  detailed  per¬ 
formance  data.  Rather,  exercise  utility  and  user  acceptance  were  the  primary 
issues  of  concern. 

All  crewmembers  participating  in  this  exercise  indicated  that  the  exer¬ 
cise  is  useful  for  practice  and  that  by  doing  similar  exercises,  their  target 
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Evaluation  1:  Average  Target  Handoff  Time  by  Crew  Position. 

Targets  located  1,000  yards  (simulated)  from  Ml  with 
750  yards  (simulated)  between  targets. 

N  =  number  of  trials. 

D  =  drivers,  L  =  loaders,  G  =  gunners. 
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Figure  9 

Evaluation  1:  Accuracy,  in  Percent,  of  Laying  Main  Gun  on  Target 
During  the  Target  Handoff  Exercise. 

Based  on  80  trials  across  drivers  (D),  96  trials  across  loaders  (L),  and 
80  trials  across  gunners  (G). 
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handoff  skills  would  improve  (see  Table  0-3).  The  Target  Kandoff  Exercise 
evaluation  summarized  in  Table  0-3  shows  that  crewmembers  found  the  exercise 
both  interesting  and  easy  to  perform.  In  addition,  most  participants  viewed 
the  exercise  as  fairly  realistic  and  indicated  they  would  use  this  type  of 
exercise  if  available  in  the  future. 

Target  Tracking  and  Leading  Exercise.  A  total  of  three  drivers,  four 
loaders,  and  four  gunners  participated  as  the  "gunner"  during  the  Target 
Tracking  and  Leading  Exercise.  Each  participant  was  scored  fifteen  times  when 
tracking  the  target  at  1,000  yards  (simulated)  and  2,000  yards  (simulated). 

In  addition,  participants  were  scored  while  leading  the  moving  target  at  simu¬ 
lated  ranges  of  1,000  yards  and  2,000  yards. 

The  results  of  the  Target  Tracking  and  Leading  Exercise  are  presented  in 
Figures  10  and  11.  Target  tracking  accuracy  (Figure  10)  varied  very  little 
between  drivers,  loaders,  and  gunners  for  both  the  1,000  yard  and  2,000  yard 
simulated  ranges.  Figure  li  illustrates  that  target  leading  performance  var¬ 
ied  considerably  between  drivers,  loaders,  and  gunners  at  the  simulated  range 
of  1,000  yards.  However,  at  the  simulated  2,000  yard  target  range,  target 
leading  performance  remained  relatively  constant  between  crew  positions.  As 
with  the  target  tracking  data,  no  statistical  tests  were  performed  using  the 
target  leading  performance  scores.  In  this  exercise,  performance  scoring  was 
completed  by  the  TC  of  each  crew.  Thus,  a  lack  of  standardization,  in  terms 
of  scoring  criteria,  may  have  existed  even  though  that  criteria  was  described 
in  the  exercise  instructions. 

Crew  evaluations  of  this  exercise  indicate  that  the  crewmembers  partici¬ 
pating  found  the  exercise  useful  for  practice.  Further,  crewmen  generally 
felt  that  by  doing  similar  exercises,  their  target  tracking  and  leading  skills 
would  improve  (see  Table  D-4).  The  Target  Tracking  and  Leading  Exercise  eval¬ 
uation  is  summarized  in  Table  0-4.  As  seen  in  that  table,  most  crewmembers 
found  the  exercise  interesting  and  useful.  This  exercise  was,  however,  some¬ 
what  less  well  received  than  was  the  handoff  exercise.  The  primary  reason  for 
this  is  the  requirement  for  one  crewmember  to  walk  with  the  target  during  this 
exercise.  This  observation  is  reinforced  by  the  crewmembers'  responses  to 
Question  13  of  Table  D-4. 
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Simulated  Target  Range 
Figure  10 

Percent  of  Trials  Scored  as  "Hit" 
When  Tracking  the  Moving  Target. 


Based  on  45  trials  across  drivers  (D),  60  trials  across  loaders 
(L),  and  60  trials  across  gunners  (G). 


SECTION  IV 


FIELD  EVALUATION  2 


This  second  field  evaluation  was  conducted  for*  two  weeks  beginning  in 
February  of  1982.  The  evaluation  took  place  at  Fort  Hood,  Texas  and  made  use 
of  eight  Ml  tank  crews.  Unlike  Field  Evaluation  1,  the  purpose  of  this  evalu¬ 
ation  was  to  assess  content  accuracy  and  user  acceptance  of  the  total  sustain¬ 
ment  training  materials  packages  and  field  exercises,  rather  than  just  a  sam¬ 
ple  tnereof. 

MATERIALS 

Sustainment  training  materials  evaluated  during  this  evaluation  included 
both  scenario  materials  and  field  exercises.  In  addition,  supporting  materi¬ 
als  were  developed  and  employed.  The  contents  of  each  of  these  materials  is 
briefly  described  below. 

Scenarios 

The  sample  of  scenarios  pilot  tested  during  the  first  field  evaluation 
were  revised  and  expanded  based  upon  the  results  of  that  evaluation.  In  addi¬ 
tion,  a  need  for  knowledge  booklets  to  preceed  the  scenarios  was  identified. 

It  became  obvious  from  the  first  field  evaluation  that  many  of  the  crewmembers 
did  not  possess  the  basic  knowledge  required  to  effectively  use  the  scenarios 
as  training  material.  Thus,  two  knowledge  booklets  were  developed  for  the 
purpose  of  providing  basic  instruction  in  the  skills  within  the  scenario  book¬ 
lets.  The  contents  of  these  two  booklets  are  briefly  described  below. 

The  first  knowledge  booklet  deals  with  Ml  tank  fire  commands.  This  book¬ 
let  provides  the  general  information  required  to  prepare  a  fire  command.  It 
also  describes  how  to  announce  a  fire  command,  including  crew's  responses,  for 
the  following  kinds  of  engagements: 

•  GPS/TIS  Precision, 

•  GPS/TIS  Battlesight, 

•  GAS  Precision,  and 

•  GAS  Battlesight. 

The  booklet  provides  brief  segments  of  written  instruction  followed  by  a  num¬ 
ber  of  multiple  choice  questions.  The  multiple  choice  questions  are  designed 
to  allow  the  student  to  validly  assess  his  mastery  of  the  instruction 
content. 

The  second  knowledge  booklet  deals  with  degraded  mode  gunnery  on  the  Ml 
tank.  This  booklet  contains  descriptions  of  the  following  Ml  tank  gunnery 
systems: 


•  Crosswind  Sensor 

•  Cant  Sensor 

•  Lead  Angle  Sensor 
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•  Laser  Rangefinder 

•  Stabilization 

•  GPS  View 

•  GPS  Reticle 

•  Tnermal  Imaging  System 

•  GPS  Symbology 

•  Gunner's  Power  Control  Handle  Trigger 

•  Gunner's  Power  Control  Handle 

Descriptions  of  the  above  gunnery  systems  include  the  characteristics  listed 
below. 

•  Function  of  the  system, 

•  How  to  tell  if  the  system  has  failed, 

•  How  to  correct  for  a  failure  during  a  non-immedi ate  engagement, 

•  How  to  correct  for  a  failure  during  an  immediate  engagement. 

This  knowledge  booklet,  like  that  developed  for  Ml  tank  fire  commands,  pro¬ 
vides  segments  of  instruction  followed  by  multiple  choice  questions. 

In  addition  to  the  two  knowledge  booklets  just  described,  a  knowledge/ 
scenario  booklet  was  developed  dealing  with  multiple  laser  returns.  This 
booklet  not  only  contains  a  number  of  scenarios,  but  also  discusses  issues 
related  to  multiple  returns.  These  issues  include: 

•  Meaning  of  multiple  returns, 

•  Identifying  multiple  returns, 

•  The  laser  RANGE  switch,  and 

•  Dealing  with  multiple  returns. 

Each  of  these  issues  are  presented  in  short  segments  of  written  instruction. 
Further,  the  text  includes  a  number  of  multiple  choice  questions  designed  for 
self-assessment  of  instruction  content  mastery. 

These  knowledge  booklets,  along  with  associated  scenario  booklets,  com¬ 
prised  the  scenario  materials  employed  during  Field  Evaluation  2.  The  follow¬ 
ing  is  the  complete  list  of  those  materials. 

Fire  Commands  for  the  Ml  Tank 


Booklet  1 
Booklet  2 
Booklet  3 
Booklet  4 
Booklet  5 
8ooklet  6 


Overview  of  Fire  Commands  (166  pages) 

Classifying  Threats  (10  scenarios) 

Ammunition /Weapon  Selection  (10  scenarios) 

Fire  Command  Elements  and  Sequence  (10  scenarios) 

Single  Target  Engagements  (12  scenarios) 
Multiple/Simultaneous  Target  Engagements  (27  scenarios) 
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Ml  Tank  Degraded  Mode  Gunnery 


Booklet  1  -  Ml  Gunnery  Systems  (51  pages) 

Booklet  2  -  Non-Immedi ate  Engagements  (44  scenarios) 
Booklet  3  -  Immediate  Engagements  (32  scenarios) 


Ml  Tank  Degraded  Mode  Gunnery 

Multiple  Returns  (Information  Section  and  11  scenarios) 

Each  scenario  booklet  began  with  a  user's  guide  which  discussed  the  pur¬ 
pose  of  the  booKlet  and  instructions  for  its  use.  In  addition,  tank  commander 
training  notes  are  presented  in  the  first  booklet  of  each  of  fire  command  and 
degraded  mode  gunnery  package.  These  training  notes  provide  an  overview  of 
the  booklets,  discuss  the  purpose  of  the  booklets,  and  describe  how  the  book¬ 
lets  can  be  used  by  the  crew.  The  scenarios  within  each  booklet  contained 
those  scenario  characteristics  described  in  Section  II. 

Field  Exercises 

The  two  field  exercises.  Target  Handoff,  and  Target  Tracking  and  Leading, 
used  during  this  evaluation  were  very  similar  to  those  used  during  the  pilot 
test.  Changes  were  made  only  in  the  step-by-step  instructions  for  conducting 
the  exercises.  These  changes  resulted  in  exercise  instructions  that  were 
extremely  clear  and  easy  for  the  TC  to  follow. 

Supporting  Materials 

In  addition  to  the  materials  listed  above,  supplementary  data  collection 
materials  were  developed  for  use  during  the  evaluation.  These  materials 
include: 

•  Experience  questionnaire.  The  questionnaire  was  very  similar  to  that 
developed  for  Field  Evaluation  1  in  that  it  addressed  crewmen  data  such 
as  length  in  service,  present  pay  grade,  previous  Ml  tank  experience,  and 
other  demographic  information. 

•  Pre-  and  post-tests  for  fire  command  booklets.  The  pre-test  and  post¬ 
test  were  identical  forms.  The  tests  consisted  of  twenty  multiple  choice 
test  items  and  five  scenarios.  Questions  and  scenarios  were  representa¬ 
tive  of  the  problems  included  in  the  fire  command  booklets. 

•  Pre-  and  post-tests  for  degraded  mode  gunnery  booklets.  The  pre-test  and 
post-test  were  identical  forms.  Tests  consisted  of  twenty  multiple 
choice  test  items  and  five  scenarios  which  are  representative  of  the 
problems  included  in  the  degraded  mode  gunnery  booklets.  Of  the  twenty 
multiple  choice  test  items,  three  items  were  related  to  the  problems  pre¬ 
sented  in  the  multiple  return  booklet. 

•  Fire  command  booklets  crew  evaluation  form.  This  evaluation  form  was 
employed  to  elicit  crewmembers'  (dirver,  loader,  gunner,  and  TC) 
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perceptions  of,  and  attitude  toward,  the  fire  command  scenarios  via 
numerous  completion  and  multiple  choice  questionnaire  items. 

•  Fire  command  booklets  TC  evaluation  form.  This  evaluation  form  was 
employed  to  identify  TC  perceptions  of  their  crew's  acceptance  of  the 
fire  command  booklets. 

•  Degraded  mode  gunnery  crew  evaluation  form.  The  evaluation  form  was  uti¬ 
lized  as  a  tool  for  obtaining  crewmember's  comments  regarding  the 
degraded  mode  gunnery  booklets.  The  evaluation  form  consisted  of  numer¬ 
ous  completion  and  multiple  choice  questionnaire  items. 

•  Degraded  mode  gunnery  TC  evaluation  form.  This  form  assisted  in  identi¬ 
fying  TC  perceptions  of  their  crew's  acceptance  of  the  degraded  mode  gun¬ 
nery  booklets. 

•  Multiple  return  booklet  evaluation  form.  This  evaluation  was  employed  to 
identify  utility  and  acceptance  of  the  multiple  return  booklet  from  the 
perspective  of  the  crewmembers. 

•  Target  handoff  exercise  evaluation  form.  This  form  consisted  of  free- 
response  and  multiple  choice  questionnaire  items  designed  to  identify  the 
crewmembers  attitude  toward  the  target  handoff  exercise. 

•  Target  tracking  and  leading  exercise  evaluation  form.  This  form,  like 
that  employed  for  evaluating  the  target  handoff  exercise,  consisted  of 
free-response  and  multiple  choice  questionnaire  items  designed  to  elicit 
the  crewmembers'  attitude  toward  the  target  tracking  and  leading 
exercise. 

The  manner  in  which  these  materials  were  employed  is  discussed  in  the  follow¬ 
ing  paragraphs. 

PROCEDURES 

All  eight  Ml  tank  crews  participating  in  the  evaluation  were  employed  for 
the  entire  two-week  period.  Each  day  during  the  two  weeks  was  divided  into 
two  periods  --  morning  (Period  1)  and  afternoon  (Period  2).  Period  1  was 
reserved  for  work  on  the  scenario  booklets  while  Period  2  was  devoted  for  the 
conduct  of  the  field  exercises.  The  following  paragraphs  describe  the  evalua¬ 
tion  procedures  of  Period  1  first,  and  follow  with  a  discussion  of  Period  2 
activities. 

Period  1 

Period  1  on  Day  1  began  with  an  overview  (given  by  Allen  Coronation  per¬ 
sonnel),  of  the  entire  field  evaluation.  On  this  day,  all  tank  crews  partici¬ 
pating  were  assembled  together  in  a  ready-room.  Following  the  overview,  expe¬ 
rience  questionnaires  were  administered.  After  questionnaire  administration, 
drivers,  loaders,  and  gunners  were  dismissed  and  only  TCs  remained.  Since  the 
TC  would  be  responsible  for  material  distribution  and  completion  during  this 
evaluation,  their  role  was  discussed  and  questions  answered.  TCs  were  then 
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given  all  the  materials  that  their  crews  would  be  using  over  the  following  two 
weeks. 

The  eight  crews  participating  in  the  evaluation  were  members  of  two  sepa¬ 
rate  platoons.  Therefore,  it  was  convenient  to  divide  the  eight  crews  by  pla¬ 
toon.  This  grouping  method  was  useful  since  only  two  rooms  were  available  to 
the  crews  to  work  on  the  training  materials. 

Beginning  on  Day  2,  each  platoon  (of  four  crews  each)  would  meet  in  the 
morning  in  their  assigned  working  areas.  They  would  then  work  through  the 
training  materials  following  a  structured  training  schedule.  This  training 
schedule  is  presented  in  Figure  12.  During  Period  1  of  each  day,  Allen  Corpo¬ 
ration  personnel  would  circulate  between  the  two  platoons  to  answer  questions 
and  administer  pre-tests,  post-tests,  and  evaluation  forms. 

Period  2 

Period  2  of  each  day  was  devoted  to  the  conduct  of  the  field  exercises. 
Again,  the  TCs  were  responsible  for  ensuring  that  an  Ml  tank  was  available  and 
that  the  exercises  were  conducted  properly.  The  field  exercises  were  per¬ 
formed  in  the  same  maneuvering  area  used  during  Field  Evaluation  1.  Like 
Field  Evaluation  1,  the  exercises  were  set  up  prior  to  each  crews'  arrival  at 
the  maneuvering  area  in  an  effort  to  make  the  best  use  of  available  training 
time.  An  Allen  Corporation  representative  was  present  at  all  times  on  the 
maneuvering  area  during  Period  2  to  monitor  progress  and  answer  any  questions 
that  might  arise.  The  training  schedule  employed  for  the  conduct  of  the  field 
exercises  is  presented  in  Figure  13. 

As  seen  in  Figures  12  and  13,  Day  4  of  the  evaluation  was  designated  as  a 
company  training  holiday.  Since  this  holiday  was  not  scheduled  or  anticipated 
by  the  researchers,  no  provisions  were  made  to  assess  its  effect  on  training. 


irst  field  evaluation,  several  unexpected  conditions  were 
encountered  which  require  mention.  These  special  conditions  relate  to  the 
testing  environment  and  personnel  availability. 

Testing  Environment.  Although  the  conditions  under  which  the  scenario 
evaluation  took  place  remained  constant  for  all  crews,  the  conditions  were 
less  than  optimum.  Specifically,  the  ready-rooms  used  by  the  crews  contained 
no  tables  and  very  few,  if  any,  chairs.  As  a  result,  crewmembers  were 
required  to  complete  the  scenario  booklets  either  standing  up  or  sitting  on 
the  floor.  Further,  the  rooms  were  not  large  enough  to  comfortably  accommo¬ 
date  the  number  of  soldiers  present.  Thus  crowding  was  experienced  which  led 
to  much  conversation  between  personnel.  Allen  Corporation  personnel  would 
often  find  individuals  comparing  scenario  answers  and  discussing  how  they  felt 
about  having  to  participate  in  the  evaluation.  Although  this  interaction  was 
discouraged  by  the  presence  of  Allen  Corporation  personnel,  there  was  always 
one  group  working  on  the  scenarios  without  Allen  Corporation  monitoring. 

Personnel  Availability.  Personnel  availability  was  a  common  problem 
throughout  this  evaluation.  A  total  of  eight  crews  (32  persons)  were  expected 
to  be  available  for  the  evaluation.  However,  it  was  often  found  (especially 
during  the  latter  portion  of  the  evaluation)  that  many  crewmembers,  and  some¬ 
times  an  entire  crew,  were  absent.  TCs  gave  many  reasons  for  the  absence  of 
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DAY  1 

(8  -  12)  All  Crews 

*  Experience  Questionnaire 

*  Fire  Commands  -  Pre-Test 

*  Fire  Commands  -  8ooklet  1 


DAY  2 

(8  -  12)  All  Crews 

*  Fire  Commands  -  Booklet  2 

*  Fire  Commands  -  Booklet  3 


DAY  3 

(8  -  12)  All  Crews 

*  Fire  Commands  -  Booklet  4 

*  Fire  Commands  -  Booklet  5 


DAY  4 

(Company  Training  Holiday) 


DAY  5 

(8  -  12)  All  Crews 

*  Fire  Commands  -  Booklet  6 

*  Fire  Commands  -  Post-Test 

*  Fire  Commands  -  Crew  Eval . 

*  Fire  Commands  -  TC  Eval. 


DAY  6 

(8  -  12)  All  Crews 

*  Degraded  Mode  Gunnery  -  Pre-Test 

*  Degraded  Mode  Gunnery  -  Booklet  1 


DAY  7 

(8  -  12)  All  Crews 
*  Degraded  Mode  Gunnery  -  Booklet  2 


DAY  8 

(8  -  12)  All  Crews 
*  Degraded  Mode  Gunnery  -  Booklet  3 


DAY  9 

(8  -  12)  All  Crews 
*  Multiple  Return  Booklet 


DAY  10 

(8  -  12)  All  Crews 

*  Degraded  Mode  Gunnery  -  Post-Test 

*  Degraded  Mode  Gunnery  -  Crew  Eval . 

*  Degraded  Mode  Gunnery  -  TC  Eval . 

*  Multiple  Return  -  Crew  Eval. 


Figure  12 

Field  Evaluation  2: 
Scenario  Training  Schedule 
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Figure  13 

Field  Evaluation  2: 

Field  Exercise  Training  Schedule 
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some  of  their  crewmemoers.  These  reasons  included:  crewmember  had  duty  the 
night  before,  illness,  tardiness,  scheduled  leave,  personal  circumstances,  and 
no  reason  at  all.  In  general,  TCs  were  not  terribly  concerned  with  ensuring 
that  their  entire  crews  were  present.  Some  TCs  even  indicated  that  they 
thought  the  evaluation  was  a  waste  of  their,  and  their  crew's  time. 

The  result  of  this  non-availability  of  some  personnel  is  a  reduction  in 
the  total  sample  population  which  evaluated  the  training  materials.  In  addi¬ 
tion,  the  reader  will  find  unequal  sample  sizes  in  the  following  discussion  of 
results  which  present  pre-test,  post-test,  field  exercise,  and  training  mate¬ 
rial  evaluation  data. 

RESULTS 

The  following  is  the  presentation  of  Field  Evaluation  2  results.  Tne 
results  cited  are  based  upon  several  data/information  sources.  These  sources 
include: 

•  Experience  questionnaires 

•  Fire  Command  Pre-  and  Post-Tests 

•  Degraded  Mode  Gunnery  Pre-  and  Post-Tests 

•  Crew  Evaluations  of  the  Fire  Command  Materials 

•  TC  Evaluations  of  the  Fire  Command  Materials 

•  Crew  Evaluations  of  the  Degraded  Mode  Gunnery  Materials 

•  TC  Evaluations  of  the  Degraded  Mode  Gunnery  Materials 

•  Target  Handoff  Exercise 

•  Target  Tracking  and  Leading  Exercise 

•  Crew  Evaluations  of  the  Target  Handoff  Exercise 

•  Crew  Evaluations  of  the  Target  Tracking  and  Leading  Exercise 

•  Allen  Corporation  Personnel  Observations 

The  results  are  presented  in  five  primary  topic  areas.  These  areas  include: 
(1)  Subject  Experience;  (2)  Fire  Command  Booklets;  (3)  Degraded  Mode  Gunnery 
Booklets;  (4)  Multiple  Return  Booklet;  and  (5)  Field  Exercises. 

Subject  Experience 

The  experience  history  of  the  crewmembers  participating  in  this  evalua¬ 
tion  is  summarized  in  Table  6.  For  purposes  of  comparison,  personnel  experi¬ 
ence  of  Field  Evaluation  1  is  also  summarized  in  this  table.  As  can  be  seen, 
the  average  ages  of  crewmembers  participating  in  this  second  evaluation  ranged 
from  20  years  for  drivers  to  26.5  years  for  TCs.  Average  length  in  service 
also  varied  across  crew  position  and  ranged  from  19.2  months  for  loaders  to 
82. a  months  for  TCs.  The  greatest  difference  in  subject  experience,  however, 
exists  in  the  category  "Average  Total  Time  on  Other  Tanks". 

When  comparing  Evaluation  2  with  Evaluation  1  data,  it  can  be  seen  that 
the  greatest  difference  in  experience  lies  in  the  time  on  other  tanks  and 
total  time  on  tanks  categories.  It  was  found  that  only  loaders  had  more  expe¬ 
rience  on  other  tanks  in  Field  Exercise  1  than  in  Field  Exercise  2.  However, 
when  comparing  total  time  in  tanks,  it  is  seen  that  both  loaders  and  TCs  in 
the  first  evaluation  had  more  experience  than  loaders  and  TCs  participating  in 
Field  Evaluation  2. 

Because  TCs  participating  in  Field  Evaluation  2  had  more  military  experi¬ 
ence  in  general,  and  more  previous  tank  experience  in  specific,  than  did  their 
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crewmembers,  their  influence  on  the  drivers,  loaders,  and  gunners  was  obvious 
to  tne  ^esearcners.  It  is  believed  that  this  influence  often  resulted  in 
b;asing  other  crewmember'  attitudes  towards  the  training  materials.  For  exam¬ 
ple,  many  TCs  verbally  indicated  their  disagreement  with  mucn  of  the  material 
content.  Later  in  the  evaluation,  drivers,  loaders,  and  gunners  also  began  to 
question  content  accuracy  in  the  same  subject  areas  previously  questioned  Dy 
the  TCs.  Thus,  data  contamination  is  a  very  real  possibility  and  should  be 
considered  when  reviewing  the  results  presented  on  the  following  pages. 

Fire  Command  Booklets 

As  with  Field  Evaluation  1,  the  objective  data  relating  to  the  training 
effectiveness  of  the  fire  command  materials  were  obtained  via  the  fire  command 
pre-  and  post-tests.  The  difference  between  fire  command  pre-  and  post-test 
scores  indicate  an  increase  in  performance  following  completion  of  the  fire 
command  booklets.  As  depicted  in  Figure  14,  the  average  fire  command  pre-test 
score  across  crew  position  was  60.4  percent  as  compared  to  the  improved  aver¬ 
age  post-test  score  of  68.2  percent.  This  difference  was  found  to  be  statis¬ 
tically  significant  at  the  0.05  level  (t=2.098,  df=47).  Although  the  fire 
command  materials  are  presented  in  a  very  readable  and  logical  manner,  they 
are,  nonetheless,  extremely  complex.  Therefore,  it  is  believed  that  the 
information  booklet  (8ooklet  1  -  Overview  of  Fire  Commands)  had  a  major  impact 
on  learning  as  seen  in  the  increased  post-test  scores.  The  fire  command  mate¬ 
rials  employed  during  the  two  field  evaluations  were  very  different,  in  terms 
of  content  accuracy  and  amount  of  material  present.  Thus,  a  comparison  of  the 
pre-test/post-test  scores  of  the  two  evalutions  would  lack  meaningful  results 
and  would  not  lend  themselves  to  interpretation. 

Performance  increases,  (although  not  statistically  significant)  were  evi¬ 
denced  by  each  crew  position  as  illustrated  in  Figure  15.  All  crew  positions 
displayed  an  increase  in  test  scores;  however,  TC  pre-test/post-test  perform¬ 
ance  (71.3 %/79.2%)  remained  the  highest,  followed  in  descending  order  by  gun¬ 
ner  (63.5%/72.0%) ,  loader  (57. l%/66.3%) ,  and  driver  (52.9^/58.4%). 

Table  0-5  of  Appendix  D  presents  a  summary  of  the  fire  command  booklets 
evaluation.  Some  of  the  major  points  seen  in  that  table  include: 

•  No  crewmember  found  the  scenarios  very  interesting.  Interest  ranged  from 
"fairly  interesting"  to  "boring". 

•  The  scenarios'  SITUATION  descriptions  were  generally  easy  to  read  and 
understand. 

•  The  correct  answers  (following  each  scenario)  were  often  viewed  as  need¬ 
ing  more  information.  Further,  crewmembers  generally  found  the  correct 
answers  as  being  "sometimes  inaccurate". 

•  Most  crewmembers  found  the  scenario  booklets  useful  and  most  indicated 
they  would  "use  them  sometimes"  if  available. 

The  most  likely  hypothesis  for  the  fire  command  materials  being  less  than 
optimally  received  is  that  the  participants  viewed  the  content  as  often  inac¬ 
curate.  TCs  repeatedly  indicated  that  the  fire  commands  presented  in  the 
booklets  were  not  the  ones  that  they  were  taught  to  use.  Further,  TCs  often 
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disagreed  with  the  booklets  in  terms  of  weapon  and  ammunition  selection  for 
the  various  types  of  targets  and  target  engagements  presented. 

The  TCs  evaluation  of  the  fire  command  booklets,  presented  in  Table  D-6, 
indicates  that  the  language  used  in  the  booklets  is  appropriate  for  their 
crewmembers 1  abilities  and  that  most  of  the  crews  did  learn  "a  little"  by 
doing  the  scenario  booklets.  Although  some  TCs  did  not  view  the  booklets  as 
being  very  useful  for  train  up  purposes,  all  TCs  indicated  that  the  booklets 
would  be  useful  for  cross  training. 

The  validity  of  the  perceived  lack  of  content  accuracy  experienced  by 
crewmembers,  particul ari ly  TCs,  is  at  best,  difficult  to  assess.  As  mentioned 
previously,  subject  matter  expertise  related  to  the  sustainment  training  mate¬ 
rial  content  was  provided  by  the  NET  Team,  Fort  Knox.  These  individuals  are 
believed  to  be  extremely  familiar  with  the  Ml  in  terms  of  its  operation  and 
capability.  In  contrast.  Ml  crew  personnel  evaluating  the  training  material 
have  interacted  with  the  Ml  tank  for  a  considerbly  shorter  period  of  time. 

That  interaction,  however,  has,  and  is  occurring  on  a  regular  (i.e.,  day-to- 
day)  basis. 

Degraded  Mode  Gunnery  Booklets 

The  primary  method  employed  to  determine  whether  learning  occurred  as  a 
result  of  using  the  degraded  mode  gunnery  booklets  was  the  administration  of 
degraded  mode  gunnery  pre-  and  post-tests.  Figure  16  depicts  the  results  of 
those  tests.  As  seen  in  that  figure,  there  exists  a  large  difference  between 
pre-test  scores  and  post-test  scores.  This  difference  is  statistically  sig¬ 
nificant  beyond  the  0.01  level  (t=3.250,  df=37)  thus  indicating  that  learning 
had  indeed  occurred.  When  reviewing  pre-  and  post-test  scores  for  each  crew 
position  (Figure  17),  it  is  obvious  that  increases  in  post-test  performance 
was  not  restricted  to  any  one  position.  With  the  exception  of  the  loaders, 
all  crew  positions  displayed  fairly  high  levels  of  post-test  performance, 
especially  TCs,  who  obtained  an  average  post-test  score  of  over  81  percent. 
Although  all  crew  positions  evidenced  increases  on  the  post-test,  this 
increase  in  performance  was  found  to  be  statistically  significant  only  for  TCs 
(t=3.378**,  df =11 ) . 

Subjective  data  related  to  the  degraded  mode  gunnery  booklets  are  pre¬ 
sented  in  Table  D-7,  Evaluation  of  Degraded  Mode  Gunnery  booklets.  The  fol¬ 
lowing  is  a  list  of  the  most  important  and  interesting  points  seen  in  that 
table. 

•  Most  crewmembers  found  the  information  booklet  "fairly  interesting". 

•  The  scenario  booklets  were  easy  to  read  and  understand  by  most. 

•  In  general,  the  scenarios  were  found  to  be  "fairly  interesting". 

•  Most  respondents  felt  they  had  learned  "some"  after  doing  the  scenarios. 

•  Most  respondents  found  the  scenario  pictures  "fairly  realistic"  and 
"fairly  useful". 

•  Mixed  reaction  is  seen  in  regards  to  the  scenarios'  correct  answers'  com¬ 
pleteness  and  accuracy. 
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Evaluation  2:  Results  of  Degraded  Mode  Gunnery  Pre-  and  Post-Tests. 
Percent  Correct  Across  Crew  Position. 
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Evaluation  2:  Results  of  Degraded  Mode  Gunnery  Pre-  and 
Percent  Correct  By  Crew  Position. 
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•  Very  few  (only  2)  individuals  had  difficulty  understanding  the  words  used 

in  the  booxlets. 

•  General  TC  comments  indicate  that  the  information  presented  in  the  book¬ 
lets  lacks  accuracy. 

The  TCs  evaluation  of  the  degraded  mode  gunnery  booklets  is  presented  in 
summary  form  in  Table  D-8.  That  table  shows  that  TCs  generally  feel  that  all 
crewmembers  should  be  familiar  with  the  information  in  Booklet  1.  Further, 
all  TCs  indicated  that  their  crews  found  the  scenario  booklets  fairly  inter¬ 
esting  and  easy  to  do.  Although  only  half  of  the  TCs  felt  that  the  booklets 
would  be  useful  for  train  up  purposes,  all  TCs  indicated  that  the  booklets 
would  be  fairly  useful  for  cross  training. 

Multiple  Return  Booklet 

Objective  performance  data  was  not  collected  separately  for  the  multiple 
return  booklet.  As  discussed  previously,  a  multiple  return  booklet  pre-test/ 
post-test  was  not  developed.  Rather,  due  to  the  brevity  of  this  material, 
three  multiple  choice  test  items  related  to  this  material  were  included  in  the 
degraded  mode  gunnery  pre-  and  post-tests.  However,  subjective  data  were  col¬ 
lected  via  an  evaluation  form.  Table  0-9  presents  a  summary  of  the  multiple 
return  booklet  evaluation.  That  table  shows  that  most  participants  found  the 
material  presented  easy  to  read  and  understand.  As  with  the  other  sustainment 
training  materials,  many  crewmembers  felt  that  the  information  presented  was 
sometimes  inaccurate. 

Field  Exercises 

The  two  field  exercises  evaluated  include  the  Target  Handoff  Exercise  and 
the  Target  Tracking  and  Leading  Exercise.  The  results  of  these  exercises  are 
briefly  described  in  the  following  paragraphs. 

Target  Handoff  Exercise.  During  the  evaluation,  an  attempt  was  made  to 
allow  loaders  and  drivers  to  participate  in  the  Target  Handoff  Exercise  on  two 
separate  occasions,  hereafter  referred  to  as  Practice  1  and  Practice  2.  A 
total  of  eight  loaders  and  three  drivers  participated  as  the  "gunner"  during 
Practice  1.  Of  these  crewmembers,  four  of  the  loaders  and  all  three  drivers 
participated  during  Practice  2.  Each  participant  performed  sixteen  target 
handoffs  (trial)  during  each  practice  session.  Data  collected  during  Prac¬ 
tice  1  and  Practice  2  are  presented  in  Figures  18  through  19.  Figure  18 
illustrates  that  average  target  handoff  time  varied  little  between  drivers  and 
loaders.  Further,  average  time  for  target  handoffs  varied  only  slightly 
between  Practice  1  and  Practice  2.  Figure  19  shows  that  drivers  achieved  a 
somewhat  higher  level  of  accuracy  of  laying  the  reticle  on  target  center-of- 
mass  than  did  loaders  during  Practice  1.  However,  the  reverse  is  true  for 
Practice  2,  as  seen  in  Figure  20.  Overall,  participants  performed  slightly 
better  during  Practice  2,  with  drivers  and  loaders  both  scoring  "center-of- 
mass"  on  more  than  75  percent  of  the  target  handoffs. 

Statistical  analyses  were  not  performed  using  data  from  the  Target  Hand¬ 
off  Exercise.  The  reasons  for  this  are  the  same  as  those  given  for  Evalua¬ 
tion  1,  namely: 
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Evaluation  2:  Average  Target  Handoff  Time  by  Crew  Position 
for  Practice  1  and  Practice  2. 

Targets  located  at  1,000  yards  (simulated)  from  Ml 
with  750  yards  (simulated)  between  targets. 

N  =  number  of  trials. 
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:  Accuracy,  in  Percent,  of  Laying  Main  Gun  on  Target 
Ouring  Handoff  Exercise  Practice  1. 


Based  on  48  trials  across  drivers  (0)  and  128  trials  across 
loaders  (L). 


•  Standardization  of  timekeeping  cannot  be  assessed.  It  is  believed  that  a 
great  deal  of  variation  in  timekeeping  activity  existed  between  crews. 

•  Standardization  of  TC  scoring  cannot  be  assessed.  Scoring  may  have 
varied  among  TCs  due  to  the  fact  that  it  is  somewhat  subjective  in 
nature.  Thus,  consistency  may  not  nave  been  maintained. 

Again,  the  intent  of  evaluating  this  exercise  was  not  to  obtain  detailed  per¬ 
formance  data.  Rather,  exercise  utility  and  user  acceptance  were  the  primary 
issues  of  concern. 

The  target  handoff  exercise  evaluation  summarized  in  Table  0-10  shows 
that  crewmembers  generally  found  the  exercise  interesting  and  easy  to  do. 
rurtner,  most  crewmembers  indicated  they  received  little  handoff  practice  and 
they  felt  this  exercise  is  useful  for  practice. 

Target  Tracking  and  Leading  Exercise.  As  with  the  Target  Handoff  Exer¬ 
cise,  an  effort  was  made  to  have  drivers  and  loaders  participate  in  the  Target 
Tracking  and  Leading  Exercise  on  two  occasions  --  Practice  1  and  Practice  2. 

A  total  of  three  drivers  and  eight  loaders  participated  as  the  "gunner"  during 
Practice  1.  Of  these  crewmembers,  four  of  the  loaders  and  all  three  drivers 
participated  during  Practice  2.  Each  participant  was  scored  fifteen  times 
when  tracking  the  target  at  1,000  yards  (simulated)  and  2,000  yards  (simu¬ 
lated)  for  Practice  1  and  Practice  2.  In  addition,  participants  were  scored 
the  same  number  of  times  when  leading  the  moving  target  at  simulated  ranges  of 
1,000  yards  and  2,000  yards  during  Practices  1  and  2. 

The  results  of  the  Target  Tracking  and  Leading  Exercise  are  presented  in 
Figures  21  and  22.  Target  tracking  accuracy  (Figure  21)  varied  little  between 
drivers  and  loaders  during  both  Practice  1  and  Practice  2.  It  is  interesting 
to  note,  however,  that  tracking  the  moving  target  at  2,000  yards  appeared  to 
be  somewhat  more  difficult,  especially  during  Practice  1,  and  resulted  in 
decreased  performance  for  both  drivers  and  loaders. 

Figure  22  illustrates  that  target  leading  performance  varied  considerably 
between  drivers  and  loaders  at  the  1,000  yard  simulated  range.  This  statement 
is  particularly  true  when  reviewing  the  Practice  1  data.  However,  at  the 
2,000  yard  range,  driver/loader  performance  differences  were  found  to  be 
greatly  reduced.  As  with  the  target  handoff  data,  no  statistical  tests  were 
performed  using  the  target  tracking  and  leading  scores.  The  reasons  previ¬ 
ously  given  for  not  performing  statistical  tests  for  the  Handoff  Exercise 
apply  to  this  exercise  as  well. 

Table  0-11  presents  the  results  of  the  Target  Tracking  and  Leading  Exer¬ 
cise.  Subject  reaction  toward  this  exercise  was  very  similar  to  that  shown 
for  the  Target  Handoff  Exercise.  Again,  most  crewmembers  indicated  that  the 
exercise  was  fairly  interesting,  fairly  realistic,  and  fairly  useful  for 
practice. 
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Figure  21 

Evaluation  2:  Percent  of  Trials  Scored  as  "Hit" 
When  Tracking  a  Moving  Target. 

0  *  drivers,  L  *  loaders,  N  =  number  of  trials. 
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Figure  22 

Evaluation  2:  Percent  of  Trials  Scored  as  "Hit" 

When  Leading  a  Moving  Target. 

D  =  drivers,  L  =  loaders,  N  =  number  of  trials. 


SECTION  V 


CONCLUSIONS 


Based  upon  data  collected  and  analyzed  during  the  field  evaluations,  and 
ooservations  made  by  the  researchers,  the  following  conclusions  were  derived. 

1.  One  of  the  major  deterrents  to  learning  encountered  during  Evalua¬ 
tion  2  was  the  lack  of  acceptance  of  the  technical  content  by  the 
tank  commanders.  Their  attitude  dearly  influenced  the  perception  of 
the  evaluation  and  acceptance  of  the  materials  by  their  crews.  Cer¬ 
tainly,  effective  leaders  do  largely  control  the  attitudes  of  the 
personnel  they  supervise.  The  disagreement  over  technical  content  is 
not  surprising,  given  the  nature  of  the  emerging  weapon  system.  This 
is  further  compounded  by  the  fact  that  the  Ml  tactical  doctrine  has 
not  been  solidly  established.  As  these  issues  are  resolved  and  uni¬ 
formity  is  imposed  on  the  armor  community,  these  obstacles  will  be 
removed.  At  that  time,  the  crews  using  these  training  materials  will 
exhibit  even  larger  learning  gains.  That  is,  tank  commanders  will 
endorse  the  technical  content  and  confer  a  positive  attitude  on  the 
training  materials.  Consequently,  their  crews  will  be  positively 
influenced  to  use  them  and  accept  the  technical  data. 

2.  The  scenario  booklets  developed  and  employed  were  found  to  be  useful 
media  for  the  type  tasks  trained  in  the  present  research.  Most  crew¬ 
members  found  the  concept  of  the  scenarios  to  be  extremely 
effective. 

3.  The  sizing  of  the  exercises,  in  terms  of  amount  of  material  to  be 
learned,  appeared  somewhat  inappropri ate  for  the  academic  level  of 
the  targeted  population  of  learners.  This  conclusion  is  especially 
true  in  regard  to  the  fire  command  booklets.  Issuing  fire  commands, 
including  the  identification  of  the  type  of  command  to  issue,  is  a 
complex  task.  Many  variations  exist  and  must  be  considered  when 
engaging  threat  targets.  It  was  observed  that  many  crewmembers, 
especially  drivers,  loaders,  and  some  gunners,  found  this  information 
somewhat  overwhelming. 

4.  The  language  used  in  the  training  material  appeared  to  be  appropriate 
for  the  target  population.  Further,  uninformed  readers  reviewed  the 
materials  to  assess  readability  and  found  that  the  materials  were 
very  acceptable  in  this  regard. 

5.  The  conditions  under  which  the  field  evaluations  took  place  may  have 
detracted  from  subject  interest,  thus  degrading  study  results.  The 
conditions  were  less  than  optimal.  For  example,  areas  designated  for 
use  during  the  evaluation  were  harsh  and  uncomfortable,  and  thus  did 
not  provide  a  supportive  learning  environment. 


6.  Scenarios,  such  as  those  evaluated  during  this  research,  may  not  be 
totally  appropriate  for  "in-the-cracks"  training.  "In-the-cracks" 
training  refers  to  training  during  periods  of  availability  under 
varying  conditions,  ranging  from  "in  the  field"  to  "in  the  barracks". 
The  conditions  of  the  present  evaluation  were  somewhat  similar  to 
conditions  which  may  be  expected  to  exist  during  "in-the-cracks" 
training.  However,  as  stated  above,  it  is  these  conditions  that  may 
have  detracted  from  the  users'  acceptance  of  the  training  materials 
evaluated. 

7.  The  field  exercises  were  successful  in  part  because  they  were  novel 
experiences  for  the  crewmembers  being  cross  trained.  These  crewmem¬ 
bers,  the  driver  and  loader,  exhibited  a  great  deal  of  enthusiasm 
regarding  participation.  It  is  well  known  that  a  positive  attitude 
towards  a  task  contributes  to  its  learning.  In  addition,  the  field 
exercises  were  generally  well  accepted  by  all  crewmembers  as  the 
exercises  gave  them  an  opportunity  to  practice  skills  that  they  do 
not  use  unless  they  are  on  a  gunnery  range. 

8.  The  knowledge/scenario  booklets  support  both  cross  training  and  train 
up  requirements.  The  pre-  and  post-test  data  gathered  during  Evalua¬ 
tion  2  clearly  show  a  learning  gain  across  crewmembers.  This  conclu¬ 
sion,  supported  by  the  quantitative  data,  contradicts  the  tank  com¬ 
manders'  subjective  opinion  that  the  training  materials  were  useful 
only  for  cross  training  purposes. 

9.  In  Evaluation  1,  the  fire  command  material  pre-  and  post-tests  showed 
a  learning  decrement.  That  finding  suggested  that  the  trainees  could 
not  learn  from  the  scenarios  alone  (and  were  possibly  confused,  thus 
the  decrement).  As  a  result,  knowledge  booklets  supporting  the  sce¬ 
narios  were  designed  and  developed.  The  inclusion  of  the  knowledge 
booklets  was  a  major  difference  between  the  two  evaluations.  It  is 
therefore  concluded  that  they  were  largely  responsible  for  the  posi¬ 
tive  learning  gains  evidenced  by  all  crewmembers  in  Evaluation  2. 


SECTION  VI 


RECOMMENDATIONS 


This  section  presents  recommendations  related  to  use  of  training  materi¬ 
als  developed  and  future  possiDi 1 ities  for  armor  unit  training.  The  recommen¬ 
dations  are  based  on  study  results  and  conclusions,  and  Allen  Corporat ion ' s 
observations  and  understanding  of  the  problem.  Recommendations  are  grouped  as 
follows: 

•  Fire  Command  Booklets 

•  Degraded  Mode  Gunnery  Booklets 

•  Multiple  Return  Booklet 

•  Fire  Command,  Degraded  Mode  Gunnery,  and  Multiple  Return  Booklets 

•  Field  Exercises 

•  Procedure  Guides 

•  General  Recommendations 
FIRE  COMMAND  BOOKLETS 

Conclusions  related  to  the  use  of  the  fire  command  booklets  indicate  that 
the  users  in  many  instances  did  not  accept  the  technical  content.  In  addi¬ 
tion,  the  sizing  of  the  booklets  may  have  been  inappropriate  due  to  the  large 
amount  and  complex  nature  of  the  material.  Finally,  it  was  concluded  that  the 
knowledge  booklet  contributed  to  learning  gains.  Recommendations  in  regard  to 
the  fire  command  booklets  are  as  follows: 

•  During  the  evaluations,  instruction  took  place  in  an  intensified  training 
period.  This  was  observed  to  have  an  intimidating  effect  on  the  sol¬ 
diers.  In  actual  application,  instructional  units  should  be  distributed 
over  longer  periods  of  time.  This  will  serve  to  diminish  the  psychologi¬ 
cal  consequence  of  the  students'  feeling  overwhelmed. 

•  Include  in  the  fire  command  booklets  many  more  opportunities  for  prac¬ 
tice.  One  method  which  can  be  employed  to  provide  the  user  with  more 
practice  activities  is  the  inclusion  of  many  more  multiple  choice  test 
items  in  the  knowledge  booklets.  Further,  the  brief  segments  of  written 
instruction,  followed  by  multiple  choice  test  items,  can  be  followed  by 
one  or  two  relatively  simple  scenarios  related  to  that  segment  of 
instruction.  This  method  will  not  only  afford  the  user  more  practice, 
but  will  also  familiarize  the  user  with  scenarios,  similar  to  those  that 
will  be  presented  in  the  remaining  fire  command  booklets. 
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DEGRADED  MODE  GUNNERY  BOOKLETS 

Major  conclusions  related  to  the  degraded  mode  gunnery  booklets  include: 
the  Knowledge  booklet  contributed  to  learning  gains,  and  the  technical  content 
of  the  material  presented  in  the  booklets  requires  investigation  to  determine 
accuracy.  Recommendations  related  to  the  degraded  mode  gunnery  booklets  are 
as  follows: 

•  Modify  the  knowledge  booklet  to  include  many  more  practice  test  items. 
These  test  items  will  assist  the  user  in  assessing  his  mastery  of  the 
instruction  presented. 

•  Include  one  or  two  simple  scenarios,  similar  in  format  to  those  presented 
in  the  scenario  booklets,  for  each  system.  These  scenarios  should  follow 
the  description  of  each  system  within  the  knowledge  booklet. 

MULTIPLE  RETURN  BOOKLET 

As  with  the  fire  command  and  degraded  mode  gunnery  booklets,  the  primary 
conclusion  related  to  the  multiple  return  booklet  is  that  the  issue  of  content 
accuracy  requires  resolution  in  order  to  ensure  user  acceptance  of  the  mate¬ 
rial.  Only  one  recommendation  appears  warranted  specifically  in  regard  to  the 
multiple  return  booklet. 

•  Multiple  return  booklet  instruction  and  scenarios  should  be  integrated 
with  the  degraded  mode  gunnery  knowledge  and  scenario  booklets.  The 
material  presented  in  the  multiple  return  booklet  could  be  included  under 
the  system  section  entitled  "Laser  Rangefinder". 

FIRE  COMMAND,  DEGRADEO  MODE  GUNNERY,  AND  MULTIPLE  RETURN  BOOKLETS 

It  was  concluded  from  the  results  of  this  research  that  the  knowlege  and 
scenario  booklets  support  both  cross  training  and  train  up  requirements.  Fur¬ 
ther,  the  scenarios  were  found  to  be  useful  media  for  the  type  of  tasks 
trained.  The  following  recommendations  are  related  to  all  knowlege  and  sce¬ 
nario  booklets. 

•  Reduce  the  knowledge  and  scenario  booklets  down  to  pocket  size.  Many  of 
the  participants  indicated  this  reduction  would  be  desirable. 

•  Produce  scenarios  using  professional  artist  renditions  for  the  illustra¬ 
tions.  Scenario  illustrations  would  be  much  more  realistic  if  they  pos¬ 
sessed  accurate  range  cues  and  target  shapes.  Advice  and  guidance  from 
an  expert  in  armor  tactics  should  also  be  elicited  when  structuring  the 
situational  elements  to  increase  realism. 

•  Investigate  the  feasibility  of  knowledge/scenario  booklet  conversion  to 
CAI  program  formats.  Such  a  program  would  permit  enhancement  of  remedia¬ 
tion.  A  further  benefit  is  that  instruction  would  become  more  personal¬ 
ized.  That  is,  incorrect  responses  to  a  question  would  be  immediately 
identified  and  explanations  would  be  provided.  The  user  would  then  have 
the  option  of  receiving  remedial  instruction.  Should  the  user  choose 
remediation,  the  program  would  automatically  present  that  information 
supporting  the  particualr  problem  at  hand.  Additionally,  a  CAI  program 


format  would  eliminate  the  requirement  for  reading  booklets.  User-;  may 
find  the  use  of  a  terminal  much  more  interesting,  thus  increasing 
motivation. 

FIELD  EXERCISES 

The  field  exercises  were  extremely  successful  in  that  the  participants 
found  the  exercises  both  interesting  and  easy  to  do.  Based  on  these  conclu¬ 
sions,  only  one  recommendation  is  given. 

•  Reduce  the  exercise  material  to  a  size  that  will  fit  into  the  soldiers' 
pocket  or  will  lend  itself  to  easy  storage  within  the  tank.  These  exer¬ 
cises  appear  very  useful  for  "i n-the-cracks"  training.  Thus,  reducing  the 
size  of  the  materials  could  very  well  increase  the  probability  of  their 
use  in  the  field. 

PROCEDURE  GUIDES 

Although  the  procedure  guides  were  not  evaluated  by  Allen  Corporation,  it 
is  assumed  that  these  materials  are  very  useful  due  to  their  similarity  to  Job 
Performance  Aids  (JPAs).  Research  literature  indicates  that  JPAs  have  a  sig¬ 
nificant  positive  impact  on  user  performance.  Based  upon  the  above  assump¬ 
tion,  the  following  is  recommended. 

•  Expand  the  procedure  guides  to  include  other  operational  and  maintenance 
tasks. 

GENERAL  RECOMMENDATIONS 

The  following  is  a  list  of  general  recommendations  related  to  the  sus¬ 
tainment  training  materials  developed  during  this  research,  use  of  these 
training  materials,  and  considerations  for  future  training  research  and  evalu¬ 
ations  in  armor  unit  training. 

•  Conduct  a  study  to  identify  other  ski  11 /task  areas  where  this  low-cost 
media  (scenarios  and  field  exercises)  could  be  useful  for  training. 

•  Ensure  that  SMEs  provide  technically  accurate  information  prior  to  evalu¬ 
ating  future  training  materials.  Thus,  if  information  presented  is  at 
variance  with  the  users'  expectations,  the  user  could  be  informed  that 
the  information  is  new,  accurate,  and  not  subject  to  question. 

•  Ensure  the  presence  of  adequate  management  control  prior  to  conducting 
field  evaluations  of  training  material.  One  major  problem  encountered  in 
the  present  research  was  that  the  sample  of  participants  constantly 
changed  because  there  was  no  pressure  to  perform  or  cooperate  in  an 
appropriate  fashion. 

•  Conduct  future  field  evaluations  under  conditions  more  conducive  to 
learning.  That  is,  equipment  and  facility  requirements  should  be  clearly 
specified  in  advance  to  assure  that  these  requirements  are  met.  This 
does  not  imply  that  facilities  be  elaborate;  rather,  they  should  merely 
be  appropriate  for  the  type  of  activities  to  be  performed  and  should 
remain  consistent  from  one  training  period  to  the  next. 
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•  Select  one  type  of  alternative  media  (refer  to  the  candidate  .media  types 
presented  in  Figure  2)  and  perform  a  comparison  study  with  the  scenario 
booklets  as  the  second  media  type.  For  example,  content  from  one  of  the 
fire  command  scenario  booklets  could  be  presented  using  a  timed  slide 
presentation.  Performance  measurements  obtained  using  this  , media  type 
could  be  compared  to  measurements  of  performance  resulting  from  ussng  the 
scenarios.  This  type  of  study  would  focus  on  assessing  user  performance 
rather  than  on  the  assessment  of  training  effectiveness.  Finally,  a 
cost-benefit  analysis  could  be  conducted  to  determine  if  the  increase  in 
media  cost  is  warranted. 

During  the  course  of  this  research,  Allen  Corporation  developed  a  compu¬ 
ter  game-type  target  tracking  and  leading  program.  Although  not  a  contract 
requirement,  this  program  was  developed  to  assess  its  potential  utility  as  a 
training  aid.  It  is  recommended  that  research  on  this  computer  game  program 
be  conducted  to  definitively  assess  its  value  as  a  learning  tool.  The  program 
is  being  submitted  to  ARI  as  part  of  the  contract  final  deliverable. 
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CREW  PROCEDURE  GUIDES 


This  Appendix  contains  the  cover  page  and  table  of  contents  from  each  of 
four  procedure  guides.  In  addition,  the  procedures  for  one  tank  commander 
is  presented. 
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GENERAL  INFORMATION 

This  booklet  contains  Ml  tank  commander  procedure  guides. 
Each  guide  is  for  a  single  pre-operation,  post-operation,  or 
during  operation  activity.  Each  guide  is  matched  to  TM-9-2350- 
255-10  (Operator's  Manual  for  Tank,  Combat,  Kull-T racked ,  105 
MM,  Ml). 

PURPOSE  OF  PROCEDURE  GUIDES 

The  guides  in  this  booklet  will  not  take  the  place  of  the 
Ml  TM  or  Ml  training  materials.  The  guides  will  aid  you  in  re¬ 
membering  long  or  difficult  secs  of  procedures.  In  short,  the 
guides  will  help  to  "jog  your  memory." 

USE  OF  THIS  BOOKLET 

The  Table  of  Contents  (on  the  next  page)  lisLs  the  proce¬ 
dure  guides  in  this  booklet.  Each  guide  gives  you  a  step-by- 
step  outline  for  completing  an  activity.  The  following  will 
help  you  to  better  use  each  guide. 

I.  Some  steps  within  a  procedure  guide  are  followed 
by  a  page  number.  On  that  page  you  will  find  a 
detailed  breakdown  of  the  step. 


Some  of  the  procedure  guides  include  a  ques¬ 
tion^).  Each  question  is  stated  inside  a  dia¬ 
mond  shape.  Your  "yes"  or  "no"  to  the  question 
will  show  you  which  path  to  follow. 


Some  steps  within  a  procedure  guide  are  followed 
by  a  box.  In  the  box  you  will  find  more  informa¬ 
tion  on  the  step  or  a  caul iou/warniug. 


4.  Certain  steps  within  a  procedure  guide  require 

^  *  * _  that  a  knob  or  switch  be  turned  to  a  certain  po- 

.  sitioti.  in  some  cases,  that  position  might  be 

^  |  '  written  like  the  symbol  to  the  left.  The  symbol 

means  that  a  light  should  also  come  on. 


5.  Master  check-off  lists  of  all  before,  during,  and 
after  operations  PMCS  performed  by  crewmembers 
are  included  as  an  aid  in  your  supervision  of 
these  activities. 


6.  Pictures  of  selected  panels/equipment  can  be  found 
at  the  end  of  this  booklet. 
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PRELIMINARY  DRAFT  -  NOT  FOR  DISTRIBUTION 


BOOKLET  NUMBER  2 


DEGRADED  MODE  GUNNERY  -  NON- IMMEDIATE  ENGAGEMENTS 
USER’S  GUIDE 

This  is  booklet  number  2  in  a  set  of  3  booklets.  The  set  deals 
with  degraded  mode  gunnery  on  the  Ml  tank.  When  you  have 
finished  the  complete  set,  you  will  be  able  to: 


TAKE  THE  CORRECT  ACTIONS  IF  A  GUNNERY  SYSTEM  FAILS  DURING 
A  NON-IMMEDIATE  OR  IMMEDIATE  ENGAGEMENT 


DEFINITION  OF  NON- IMMEDIATE  AND  IMMEDIATE  ENGAGEMENTS 


The  terms  non-immedia te  engagement  and  immediate  engagement  may 
be  new  to  you.  They  will  be  used  in  all  of  the  booklets.  They 
are  defined  as  follows: 


NON-IMMEDIATE  ENGAGEMENT  - 

•  The  threat  has  not  seen  you  or  cannot  kill  you- 

•  Before  you  engage,  you  do  have  time  to  identify  and  cor¬ 
rect  for  unknown  gunnery  system  failures. 


IMMEDIATE  ENGAGEMENT  - 

•  The  threat  has  seen  you  or  can  kill  you. 

•  Before  you  engage,  you  do  not  have  time  to  identify  and 
correct  for  unknown  gunnery  system  failures- 


The  actions  you  take  in  this  set  of  booklets,  and  in  battle, 
will  depend  on  whether  the  engagement  is  non-immediate  or  imme¬ 
diate. 


BE  SURE  YOU  CAN  DEFINE  EACH  TYPE  OF  ENGAGEMENT! 


THIS  BOOKLET 

This  booklet  will  give  you  practice  in  dealing  with  degraded 
mode  gunnery  during  non-immediate  engagements. 

The  booklet  contains  a  number  of  battlefield  scenario 
scenario  contains: 


•  A  PICTURE  OF  THE  BATTLEFIELD  SITUATION. 

•  A  SHORT  WRITTEN  DESCRIPTION  OF  THE  BATTLEFIELD  SITUATION 
AND  THE  STATUS  CF  YOUR  TANK  • 

•  A  QUESTION  FOR  YOU  TO  ANSWER  - 


FOR  PURPOSES  OF  THESE  SCENARIOS,  YOU  SHOULD  ATTEMPT  TO 
ENGAGE  ALL  TARGETS  SEEN  . 


HOW  TO  USE  THIS  BOOKLET 


.  Look  at  the  scenario  picture. 

.  Read  the  short  written  description. 

>.  Read  and  answer  the  scenario  question. 


SOME  QUESTIONS  ARE  FOLLOWED  BY  A  LIST  OF  POSSIBLE 
ANSWERS.  FOR  THESE  QUESTIONS,  YOU  SHOULD  SELECT 
THE  CORRECT  ANSWER. 

SOME  QUESTIONS  DO  NOT  HAVE  A  LIST  OF  POSSIBLE  ANSWERS. 
FOR  THESE  QUESTIONS,  YOU  MUST  PROVIDE  YOUR  OWN  ANSWER. 


4.  check  your  answer  with  the  Answer  Key  on  the  page 
following  the  scenario. 

5.  Complete  the  rest  of  the  scenarios. 


BEFORE  YOU  USE  THIS  BOOKLET 


Before  you  use  this  booklet,  be  sure  you  have  completed 
Booklet  1  of  the  set. 

TANK  COMMANDER  TRAINING  NOTES 


Training  notes  are  presented  in  Booklet  1. 


SCENARIO  1 


SCENARIO  1  ANSWER 


You  should  have  selected  B:  Perform 

computer  self 
test 

When  the  F  appears  In  GPS  during  a  non- 
immediate  engagement  always  run  a  computer 
self  test.  The  self  test  will  tell  you 
which  system  has  failed. 


WRONG  ANSWERS 


A.  You  do  not  know  if  the  CANT  sensor  has 
failed. 

C.  You  do  not  know  if  the  lead  angle 
sensor  has  failed. 

0.  Run  a  self  test  first.  You  may  not 
have  to  use  the  GAS. 
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target  handoff  practice.  Using 


1)  Prepare  Targets 

A.  Use  5  white  poster  boards.  E.  Number  the  targets  1-5  like  in 


e  Targets 

Put  a  marker  where  your  tank 
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ENERAL  INSTRUCTIONS 

arget  handoff  is  a  shared  task  for  the  TC  To  do  this  exercise,  the  crew  will  need: 

nd  gunner.  In  a  battle  situation,  however. 
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APPENDIX  D 


ADDITIONAL  EVALUATION  RESULTS 


This  Appendix  contains  the  data  obtained  via  the  sustainment  training 
material  evaluation  forms.  Specifically,  the  data  presented  in  this  Appendix 
include: 

Table  D-l.  Field  Evaluation  1  -  Evaluation  of  Fire  Command  Scenarios 

Table  D-2.  Field  Evaluation  1  -  Evaluation  of  Degraded  Mode  Gunnery 

Scenarios 

Table  D-3.  Field  Evaluation  1  -  Evaluation  of  Target  Handoff  Exercise 

Table  D-4.  Field  Evaluation  1  -  Evaluation  of  Target  Tracking  and  Lead 

ing  Exercise 

Table  D-5.  Field  Evaluation  2  -  Evaluation  of  Fire  Command  Booklets 

Table  0-6.  Field  Evaluation  2  -  Tank  Commander  Evaluation  of  Fire  Com¬ 

mand  Booklets 

Table  D-7.  Field  Evaluation  2  -  Evaluation  of  Degraded  Mode  Gunnery 
Booklets 

Table  D-8.  Field  Evaluation  2  -  Tank  Commander  Evaluation  of  Degraded 
Mode  Gunnery  Booklets 

Table  D-9.  Field  Evaluation  2  -  Evaluation  of  Multiple  Returns  Booklet 

Table  D-10.  Field  Evaluation  2  -  Evaluation  of  Target  Handoff  Exercise 

Table  0-11 .  Field  Evaluation  2  -  Evaluation  of  Target  Tracking  and  Lead 

ing  Exercise 


Table  0-1.  Field  Evaluation  1  - 
Evaluation  of  Fire  Command  Scenarios 

Responses 

Question  Driver  Loader  TC 


1.  The  instructions  were  _  to  read. 

_ very  easy  1  12 

_ easy  3  27 

_ a  little  hard  1  i 

_ very  hard  0  0  0 

2.  The  instructions  were _ to  understand. 

_ very  easy  0  0  2 

_ easy  3  2  7 

_ a  little  Hard  2  2  0 

_ very  hard  0  00 

3.  The  instructions  were _ . 

_ very  complete  1  10 

_ mostly  complete  1  25 

_ complete,  but  could  use  more 

information  3  14 

_ incomplete,  needed  much  more 

information  0  00 

4.  The  SITUATION  description  was  _  to  read. 

_ very  easy  0  12 

_ easy  3  27 

_ a  little  hard  2  0  0 

_ very  hard  010 


Total 


4 

12 

2 

0 


2 

12 

4 

0 


2 

8 

8 

0 


3 

12 

2 

1 


0-2 


Table  0-1.  (cont 'd. ) 


Responses 
Driver  Loader  TC 


Question 


The  SITUATION  description  was 

_ very  easy 

_ easy 

_ a  little  hard 

_ very  hard 

The  SITUATION  description  had 

_ too  much 

_ the  right  amount  of 

_ not  quite  enough 

_ not  nearly  enough 


to  understand. 

0  0  2 

2  4  6 

3  0  1 

0  0  0 

information. 

0  0  1 

3  3  4 

2  1  4 

0  0  0 


The  pictures  were _  In  doing  the  scenarios. 

_ very  helpful 

_ a  little  helpful 

_ not  very  helpful 

not  helpful  at  all 


3 

1 

1 

0 


3  6 

0  3 

0  0 

1  0 


The  pictures  and  SITUATION  descriptions  were 


very  realistic  1 
fairly  realistic  3 
not  realistic,  but  useful  1 
not  realistic  and  not  useful  0 


1  1 

3  4 

0  4 

0  0 


The  answers  were _ . 

_ very  accurate  and  complete 

_ fairly  accurate  and  complete 

_ accurate,  but  not  complete 

_ not  accurate  or  complete 


1  1  0 
2  2  6 
2  1  2 
0  0  1 


Table  0-1.  (cont 'd  ) 


Question 


Responses 

Driver  Loader  TC  Total 


10.  The  scenarios  were _ to  do. 

_ too  hard 

_ hard 

_ easy 

too  easy 


0 

1 

4 

0 


0  0  0 

2  1  4 

2  8  14 

0  0  0 


11.  The  scenarios  were  _  to  do. 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 


3 

2 

0 

0 


2  3  8 

2  6  10 

0  0  0 

0  0  0 


12.  The  scenarios  are _ for  practice. 

_ very  useful 

_ fairly  useful 

_ not  very  useful 

useless 


4 

1 

0 

0 


3  7  14 

1  2  4 

0  0  0 

0  0  0 


13.  By  doing  the  scenarios,  I  learned 

_ a  lot 

_ some 

_ not  very  much 

_ nothing  at  all 


2  3  3 

3  1  4 

0  0  2 

0  0  0 


8 

8 

2 

0 


14.  If  many  of  these  scenarios  were  available,  I  would 


use  them  a  lot  2 
use  them  sometimes  3 
not  use  them  much  0 
not  use  them  at  all  0 


1 

3 

0 

0 


5 

4 

0 

0 


8 

10 

0 

0 


0-4 


Taole  D-2  Field  Evaluation  1  - 
Evaluation  of  Degraded  Mode  Gunnery  Scenarios 


Question 

1.  The  instructions  were 

_ very  easy 

_ easy 

_ _ a  little  hard 

_ very  hard 


Driver 

to  read. 

0 

3 

1 

0 


Responses 

Loader  Gunner  Total 


2  1  3 

1  5  9 

1  1  3 

1  0  1 


2.  The  instructions  were  _  to  understand. 

_ very  easy  0 

_ easy  3 

_ a  little  hard  1 

_ very  hard  0 

3.  The  instructions  were  _ . 

_ very  complete  .  0 

_ mostly  complete  3 

_ complete,  but  could  use  more 

information  1 

_ incomplete,  needed  much  more 

information  0 

4.  The  SITUATION  description  was  _  to  read. 

_ very  easy  0 

_ easy  4 

_ a  little  hard  0 

_ very  hard  0 


1 

2 

2 

0 


1 

1 

3 

0 


2 

2 

1 

A 

0 


1 

4 

2 

0 


2 

2 

3 

0 


1 

4 

2 

0 


2 

9 

5 

0 


3 

6 

7 

0 


3 

10 

3 

0 


D-5 


■ - 

1 

■N  W  .  '  .  1 

••  ^ 

» 

Taole  0-2 

.  (cont’d.) 

a 

Responses 

Question 

Dri ver 

Loader 

Gunner 

Total 

5. 

The  SITUATION  description  was  _ 

_  to  understand. 

i 

_ very  easy 

0 

1 

0 

1 

'  j 

_ easy 

4 

3 

4 

11 

»*- 

_ a  little  hard 

0 

0 

2 

2 

i 

very  hard 

0 

1 

1 

2 

■ 

S;  6. 

The  SITUATION  description  had  _ 

information. 

too  much 

*0 

0 

1 

1 

the  right  amount  of 

3 

3 

3 

9 

m 

_ not  quite  enough 

1 

2 

3 

6 

>v 

_ not  nearly  enough 

0 

0 

0 

0 

y  7‘ 

The  pictures  were _  in  doing  the  scenarios. 

| 

_ very  helpful 

3 

4 

5 

12 

V* 

_ a  little  helpful 

1 

1 

1 

3 

_ not  very  helpful 

0 

0 

1 

1 

i 

_ not  helpful  at  all 

0 

0 

0 

0 

A  8. 

The  pictures  and  SITUATION  descriptions  were  _ 

• 

_ very  realistic 

1 

1 

3 

5 

_ fairly  realistic 

3 

3 

2 

8 

« 

_ not  realistic,  but  useful 

0 

1 

2 

3 

1,* 

not  realistic  and  not  useful 

0 

0 

0 

0 

o, 

£  9’ 

The  answers  were _ . 

m 

_ very  accurate  and  complete 

1 

2 

1 

4 

_ fairly  accurate  and  complete 

3 

1 

5 

9 

Si 

:v 

_ accurate,  but  not  complete 

0 

1 

1 

2 

« 

_ not  accurate  or  complete 

0 

1 

0 

1 

0-6 

i 

'  '  ,  ,  .1 

*  .  ■  *'  iV*.  -  ^  t  1 * 

Table  D-2.  (cont'd. ) 


luestion 


Responses 

Driver  Loader  Gunner 


Total 


The  scenarios  were 
too  hard 


to  do, 


_ too  easy 

The  scenarios  were  _  to  do. 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 


The  scenarios  are  _  for  practice. 

_ very  useful 

_ fairly  useful 

_ not  very  useful 

useless 


By  doing  the  scenarios,  I  learned 

_ a  lot 

_ some 

_ not  very  much 

_ nothing  at  all 


(1  abstention) 


If  many  of  these  scenarios  were  available,  I  would _ . 

_ use  them  a  lot  2  1 

_ use  them  sometimes  2  4 

_ not  use  them  much  0  0 

not  use  them  at  all  00 


i  i v ' 1  1"  «■  ' 


■HI.  ilM 


Table  D-3.  Field  Evaluation  1  - 
Evaluation  of  Target  Handoff  Exercise 


Question 


Responses 
Driver  Loader  Gunner 


TC 


Total 


1.  The  instructions  were 

_ very  easy 

_ easy 

_ a  little  hard 

very  hard 


to  read. 


0 

6 

0 

0 


5 

1 

0 

0 


1 

4 

0 

0 


1 

5 

0 

0 


7 

16 

0 

0 


2. 


The  instructions  were 

_ very  easy 

easy 

a  little  hard 
_ very  hard 


to  understand. 

2 

4 

0 

0 


3. 


The  instructions  were _ . 

_ very  complete 

mostly  complete 

_ complete,  but  could  use  more 

information 

incomplete,  needed  much  more 
information 

The  target  handoff  exercise  was 

_ very  realistic 

_ fairly  realistic 

_ not  realistic,  but  useful 

not  realistic  and  not  useful 


D-8 


2 

3 

1 

0 


1 

5 

0 

0 


4 

2 

0 

0 


4 

1 


1 

0 


1 

5 

0 

0 


1 

4 

0 

0 


1 

4 

0 

0 


2 

2 

1 

0 


1 

5 

0 

0 


1 

4 

1 

0 


2 

4 

0 

0 


8 

15 

0 

0 


8 

12 


3 

0 


6 

16 

1 

0 


* 


Table  D-3.  (cont'd.) 


Question 


Responses 

Driver  Loader  Gunner  TC  Total 


The  dark  targets  make  the  GPS  reticle  _  to 

_ too  easy  0 

_ easy  6 

_ a  little  hard  0 

too  hard  0 


see. 

0 

6 

0 

0 


1  i  2 

4  5  21 

0  0  0 

0  0  0 


The  exercise  was  _  to  do. 

_ too  hard 

_ hard 

_ easy 

too  easy 


0 

0 

6 

0 


0  0  0  0 

0  0  0  0 

6  4  6  22 

0  10  1 


The  handoff  exercise  was 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 


2 

4 

0 

0 


2  3  2  9 

4  ,24  14 

0  0  0  0 

0  0  0  0 


The  excercise  is  _  for  practice. 

_ very  useful 

_ fairly  useful 

_ not  very  useful 

useless 


5  4  3  16 

113  7 

0  0  0  0 

0  0  0  0 


By  doing  the  exercise,  I  learned  _ . 

_ a  lot 

_ some 

not  very  much 
_ nothing  at  all 


3  12  7 

3  3  3  14 

0  0  1  1 

0  10  1 


0-9 


Table  0-3.  (cont 'd. j 

Responses 

Question  Driver  Loader  Gunner  TC  Total 

10.  By  doing  exercises  like  this  one,  my  handoff  skills  would  _ . 

_ improve  a  lot  2  4  2  4  12 

_ improve  a  little  3  2  3  2  10 

_ not  improve  0  0  0  0  0 

_ get  worse  00000 

11.  The  thing  I  liked  most  about  this  exercise  was: 

Driver:  Laying  on  the  targets.  Learning  about  the  gunner  position,  and- 
how  and  what  I  do. 

Loader:  Scanning,  and  trying  to  beat  the  clock.  Target  practice. 

Getting  some  time  in  the  gunner's  seat.  It  was  not  difficult. 
Gunner:  Practice  using  the  controls.  More  experience.  Leaving  the 
motor  pool.  It  was  easy  but  helpful. 

TC;  Everything.  Laying  the  gun  for  direction  and  working  with  the 

gunner.  Each  crew  member  got  to  familiarize  himself  with  the 
gunner's  skills.  The  coordination  between  TC  and  gunner.  The 
practice. 

12.  The  thing  I  liked  least  about  this  exercise  was: 

Driver:  All  the  paperwork.  Lining  the  reticle  up. 

Loader:  I  liked  it  all.  Paperwork.  Wished  I  had  more  time. 

Gunner:  Too  simple. 

TC:  Due  to  the  closeness  of  the  targets,  the  TC  does  not  get  any 

practice  laying  the  gun.  Not  having  my  own  gunner. 

13.  If  many  of  these  exercises  were  available,  I  would  _ . 

_ use  them  a  lot  51039 

_ use  them  sometimes  1  5  4  2  13 

_ not  use  them  much  0  0  0  0  0 

not  use  them  at  al 1  0  0  10  1 


0-10 


Evaluation  of  Target  Tracking  and  Leading  Exercise 


Question 


Responses 

Driver  Loader  Gunner  TC 


The  instructions  were _ to  read. 

_ very  easy 

_ easy 

_ a  little  hard 

_ very  hard 


0 

2 

0 

0 


2  0  0 

1  4  3 

0  0  1 

0  0  0 


The  instructions  were 

to  understand. 

very  easy 

0 

2 

easy 

2 

1 

a  little  hard 

0 

0 

_ very  hard 

0 

0 

1  1 

3  3 

0  0 

0  0 


The  instructions  were _ . 

_ very  complete 

_ mostly  complete 

_ complete,  but  could  use  more 

information 

_ incomplete,  needed  much  more 

information 


12  11 
113  3 

0  0  0  0 

0  0  0  0 


The  target  tracking  and  leading  exercises  were 


very  realistic 
fairly  realistic 
not  realistic,  but  useful 
not  realistic  and  not  useful 


0  0  11 
2  2  2  2 
0  111 
0  0  0  0 


4- 


Table  D-4 .  (cont 'd. ) 


Question 


Responses 

Driver  Loader  Gunner  TC 


The  dark  targets  make  the  GPS  reticle  _  to  see- 

_ too  easy  0  0 

_ easy  2  3 

_ a  little  hard  0  0 

too  hard  0  0 


During  the  exercises,  the  target  _ 

_ bounced  up  and  down  too  much 

_ looked  like  a  target  'moving  over 

rough  terrain 

did  not  move  up  and  down  much 
_ should  move  up  and  down  more 


The  exercises  were 
too  hard 


to  do. 


_ too  easy  0 

8.  The  tracking  and  leading  exercises  were  _ 

_ very  interesting  0 

_ fairly  interesting  2 

_ not  very  interesting  0 

_ boring  0 


The  exercises  are 

_ very  useful 

_ fairly  useful 

_ not  very  useful 

useless 


for  practice. 


Table  D-4.  (cont'd. ) 


Question 


Responses 

Driver  Loader  Gunner  TC  Total 


By  doing  exercises,  I  learned  _ . 

_ a  lot  12216 

_ some  112  3  7 

_ not  very  much  0  0  0  0  0 

nothing  at  all  00000 

By  doing  exercises  like  these,  my  tracking  and  leading  skills  would _ . 

_ improve  a  lot  112  3  7 

_ improve  a  little  12  2  16 

_ not  improve  00000 

_ get  worse  00000 


The  thing  I  liked  most  about  this  exercise  was: 

Driver:  No  comments. 

Loader:  Tracking  in  front  of  the  target.  Searching  and  identifying  the 
target.  It  was  easy  to  do. 

Gunner:  It  gave  me  a  chance  to  experience.  Riding  outside  the  motor 
pool  on  the  Ml.  Tracking  capabilities.  We  each  got  to  do  it. 

TC:  The  practice  time.  Actually  laying  the  gun  and  tracking. 

Helped  become  familiar  with  the  reticle  and  using  the  proper 
lead.  It  was  challenging  to  the  gunner. 


13.  The  thing  I  liked  least  about  this  exercise  was: 

Driver:  No  comments. 

Loader:  Walking  with  the  tank  target. 

Gunner:  Moving  with  the  target. 

TC:  The  target  was  moving  too  fast  for  the  short  distance.  The  use 

of  people  from  the  crew  to  carry  the  target.  Too  much  target 
movement . 


0-13 


Table  0-4.  (cont'd.) 


Question 


Responses 

Driver  Loader  Gunner  TC 


If  many  of  these  exercises  were  available. 


use  them  a  lot  1 
use  them  sometimes  1 
not  use  them  much  0 
not  use  them  at  al 1  0 


I  would _ . 

0  2 

3  2 

0  0 

0  0 


2 

2 

0 

0 


Table  0-5.  Field  Evaluation  2  - 

Evaluation  of  Fire 

Command 

Booklets 

Responses 

Question 

Driver 

Loader 

Gunner 

TC 

The  information  booklet  (Booklet  1) 

was _ 

_ very  easy  to  read 

2 

2 

0 

2 

_ easy  to  read 

3 

4 

2 

3 

_ a  little  hard  to  read 

0 

0 

0 

0 

very  hard  to  read 

0 

0 

0 

0 

The  information  booklet  (Booklet  1) 

had  _ 

. 

_ too  much  information 

2 

1 

0 

0 

the  right  amount  of  information 

2 

4 

1 

1 

_ not  quite  enough  information 

1 

1 

1 

3 

much  too  little  information 

0 

0 

0 

1 

The  information  booklet  (Booklet  1) 

was _ 

• 

very  interesting 

0 

1 

0 

0 

_ fairly  interesting 

3 

2 

1 

3 

not  very  interesting 

1 

2 

1 

2 

_ boring 

1 

1 

0 

0 

After  reading  the  information  booklet  (Booklet  1)  I 

think  I 

learned 

_ a  lot 

0 

0 

0 

0 

_ some 

3 

4 

2 

3 

not  very  much 

2 

2 

0 

2 

_ nothing 

0 

0 

0 

0 

I  found  the  questions  in  the  booklet  (Booklet  1)  _ 

I 

_ _ very  helpful 

1 

1 

0 

0 

_ somewhat  helpful 

2 

2 

2 

4 

_ not  very  helpful 

2 

2 

0 

1 

_ not  helpful  at  all 

0 

0 

0 

0 

U 

abstention) 

Ill 


Table  0-5.  (cont'd.) 


La 

? 


y. 


E 


1 

♦  / 


| 

\ 

*4 

> 


r 


;\ 


Responses 


Question 

Driver 

Loader 

Gunner 

TC 

Total 

6. 

The  scenario  booklets  (Booklets  2 

-  6)  were  _ 

_ _ . 

very  easy  to  read 

2 

1 

0 

1 

4 

easy  to  read 

2 

3 

1 

4 

10 

a  little  hard  to  read 

1 

1 

1 

0 

3 

very  hard  to  read 

0 

1 

0 

0 

1 

7. 

The  instructions  for  doing  the  scenarios  were  _ . 

very  easy  to  understand 

2 

1 

0 

2 

5 

easy  to  understand 

1 

3 

2 

3 

9 

a  little  hard  to  understand 

2 

2 

’  0 

0 

4 

very  hard  to  understand 

0 

0 

0 

0 

0 

8. 

The  scenarios  were _ . 

very  interesting 

0 

0 

0 

0 

0 

fairly  interesting 

4 

4 

1 

2 

11 

not  very  interesting 

0 

1 

1 

3 

5 

_ boring 

1 

1 

0 

0 

2 

9 

After  doing  the  scenarios  in  Booklets  2-6 

,  I  think 

I  learned 

_ • 

_ a  lot 

2 

0 

0 

0 

2 

_ some 

2 

4 

2 

3 

11 

not  very  much 

1 

2 

0 

2 

5 

_ _nothing 

0 

0 

0 

0 

0 

10.  The  scenario  pictures  were  _ . 

_ very  realistic 

_ fairly  realistic 

not  realistic,  but  useful 
not  realistic  and  not  useful 


10  11 
0  3  12 

4  2  0  2 

0  10  0 


3 

6 

8 

1 


;  o-i6 

i 


Table  0-5.  (cont 'd. ) 


Responses 


Question 

Driver  Loader 

Gunner 

TC 

When  doing  the  scenarios,  I  found 

the  pictures 

_ • 

very  helpful 

2 

1 

1 

0 

fairly  helpful 

2 

4 

1 

2 

not  very  helpful 

1 

0 

0 

1 

not  helpful  at  all 

0 

0 

0 

0 

(3  abstentions) 

If  the  scenario  pictures  were  more  realistic. 

it  would  _ . 

help  a  lot 

1 

0 

1 

2 

help  a  little 

1 

4 

1 

1 

not  help,  but  would  be  nice 

2 

1 

0 

1 

make  no  difference 

1 

1 

0 

1 

If  the  scenario  pictures  were  in 

color,  they  would 

• 

be  much  more  useful 

1 

0 

0 

0 

be  a  little  more  useful 

0 

2 

2 

2 

not  be  any  more  useful 

4 

3 

0 

2 

(2  abstentions) 

The  SITUATION  descriptions  were  _ 

« 

1 

very  easy  to  read 

1 

1 

0 

easy  to  read 

1 

3 

2 

4 

a  little  hard  to  read 

3 

2 

0 

0 

very  hard  to  read 

0 

0 

0 

0 

I  found  the  SITUATION  descriptions  _ . 

very  easy  to  understand 

2 

0 

0 

1 

easy  to  understand 

1 

4 

2 

3 

a  little  hard  to  understand 

2 

2 

0 

1 

very  hard  to  understand 

0 

0 

0 

0 

Total 


4 

9 

2 

0 


4 

7 

4 

3 

1 

6 

9 


3 

10 

5 

0 


3 

10 

5 

0 


Table  0-5.  (cont 'd. ) 


Responses 


Question  Driver 

Loader  Gunner 

TC 

Total 

The  SITUATION  descriptions  had  _ . 

_ too  much  information 

1 

0 

0 

0 

1 

the  right  amount  of  information 

2 

3 

I 

0 

6 

not  quite  enough  information 

2 

2 

1 

5 

10 

not  nearly  enough  information 

0 

1 

0 

0 

1 

I  found  that  the  correct  answers  were 

_ very  complete 

0 

0 

0 

0 

0 

_ mostly  complete 

3 

4 

0 

0 

7 

complete,  but  could  use  more 

information 

1 

1 

1 

2 

5 

incomplete,  needed  much  more 

information 

1 

1 

1 

2 

5 

(1  abstention) 

I  found  that  the  correct  answers  were 

• 

_ very  accurate 

0 

0 

0 

0 

0 

_ usually  accurate 

0 

5 

0 

0 

5 

_ sometimes  inaccurate 

5 

1 

2 

5 

13 

_ usually  inaccurate 

0 

0 

0 

0 

0 

Sometimes,  there  was  a  brief  explanation  of 

the  1 

wrong  answers . 

I  found 

these  explanations _ . 

_ very  useful 

1 

1 

0 

1 

3 

_ fairly  useful 

3 

3 

2 

2 

10 

_ not  very  useful 

0 

1 

0 

2 

3 

_ useless 

0 

1 

0 

0 

1 

(1  abstention) 

Table  D-5.  (cont'd. ) 


Question 


Responses 

Driver  Loader  Gunner  TC  Total 


When  the  wrong  answers  were  explained,  the  explanations  usually  had 


too  much  information 

1  . 

0 

0 

0 

_ the  right  amount  of  information 

2 

3 

0 

1 

_ not  quite  enough  information 

1 

3 

2 

3 

_ not  nearly  enough  information 

The  words  used  in  the  booklets  were 

1 

0 

0 

1 

_ too  simple 

1 

0 

0 

1 

_ just  right 

1 

5 

2 

3 

_ sometimes  hard  to  understand 

3 

1 

0 

1 

_ often  hard  to  understand 

0 

0 

0 

0 

If  many  more  fire  command  gunnery  scenario 
would  _ . 

booklets 

were 

available 

_ use  them  a  lot 

0 

0 

0 

0 

_ use  them  sometimes 

1 

3 

2 

4 

_ not  use  them  much 

3 

1 

0 

1 

not  use  them  at  all 

1 

1  0  0 

(1  abstention) 

If  scenario  booklets  on  other  topics 

were 

available. 

I  would  _ . 

_ use  them  a  lot 

2 

0 

0 

0 

_ use  them  sometimes 

0 

4 

2 

4 

not  use  them  much 

2 

0 

0 

1 

not  use  them  at  all 

1 

1 

0 

0 

(1  abstention) 


1 

6 

9 

2 


2 

11 

5 

0 


I 


0 

10 

5 

2 


2 

10 

3 

2 


w 


m 

V*‘ 
v,  • 

/•'. 


m 


Question 


Table  0-5.  (cont 'd. ) 

Responses 

Driver  Loader  Gunner  TC 


Total 


24.  The  scenario  booklets  were  printed  on  regular  size  paper.  If  these 
booklets  were  made  smaller  so  they  could  fit  in  my  pocket,  I  would  _ 


_ use  them  much  more  1 

_ use  them  a  little  more  0 

not  use  them  any  more  than  the  way 
they  are  now  3 

use  them  less  0 


25.  Other  comments:  No  comments. 


0 

3 

0 

1 


1 

0 

0 

1 


0 

2 

2 

1 


(3  abstentions) 


2 

5 

5 

3 


m 


>• 


D-20 


i 


Table  0-6,  Field  Evaluation  2  - 
Tank  Commander  Evaluation  of  Fire  Command  3ooKlets 

Question  TC  Responses 


1.  Ouring  the  past  week,  you  have  actually  sent  your  crew 
through  a  mini  training  program.  The  fire  command  Dook- 
lets  (Booklets  1-6)  contained  notes  for  the  tank  com¬ 
mander  and  instructions  for  using  the  booklets.  How  com¬ 


plete  were  these  notes  and  instructions? 

_ very  complete  1 

_ mostly  complete  2 

_ complete,  but  could  use  more  information  2 

_ not  complete,  needed  much  more  information  0 

2.  Most  of  your  crew  found  the  information  in  Booklet  1  _ . 

_ very  easy  to  understand  0 

_ easy  to  understand  4 

_ a  little  hard  to  understand  1 

_ very  hard  to  understand  0 


3.  Did  any  of  your  crewmembers  have  difficulty  going  through 


the  information  booklet? 

_ yes  2 

_ no  3 

If  yes,  which  crewmember(s)  had  the  most  difficulty? 

_ Driver  2 

_ Loader  1 

_ Gunner  0 

4.  The  language  used  in  Booklet  1  was _ . 

_ very  easy  for  you r  crew  to  understand  0 

____just  right  for  your  crew  to  understand  5 

_ a  little  hard  for  your  crew  to  understand  0 

_ very  hard  for  your  crew  to  understand  0 


0-21 


Table  0-5.  (cont’d. ) 


Question 


TC  Responses 


5.  Which  crewmember(s)  would  you  want  to  be  familiar  with 
information  in  Booklet  1? 

_ Driver 

_ loader 

_ Gunner 

6.  Most  of  your  crew  found  the  information  booklet 

(Booklet  1)  _ . 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 

7.  By  doing  the  scenario  booklets,  most  of  your  crew 

learned _ . 

_ a  lot 

_ a  little 

_ not  much 

_ nothing 

8.  Most  of  your  crew  found  the  scenario  booklets  _ . 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 

9.  Most  of  your  crew  found  the  scenarios  _ . 

_ very  easy  to  do 

_ easy  to  do 

_ a  little  hard  to  do 

_ very  hard  to  do 


2 

3 

5 


0 

5 

0 

0 


0 

5 

0 

0 


0 

4 

1 

0 


0 

4 

1 

0 
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Table  D-6.  (cont 'd. ) 


Question 


TC  Responses 


10.  For  train  up  purposes,  this  set  of  booklets  is 


very  useful  1 

_ fairly  useful  2 

_ not  very  useful  2 

_ useless  0 

11.  For  cross  training,  this  set  of  booklets  is _ . 

_ very  useful  0 

_ fairly  useful  5 

_ not  very  useful  0 

useless  0 


12.  If  many  more  fire  command  scenario  booklets  were  avail¬ 
able,  how  often  would  you  want  your  crew  to  use  them? 


very  often  2 
sometimes  2 
not  very  often  1 
never  0 


13.  If  many  more  scenario  booklets  on  other  topics  were 
available,  how  often  would  you  want  your  crew  to  use 


them? 

_ very  often  2 

_ sometimes  2 

_ not  very  often  1 

never  0 
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Taole  D-6.  (cont'd.) 


Question 


TC  Responses 


14.  If  you  had  score  sheets  on  whicn  to  track  your  crewmem¬ 
ber's  performance,  would  you  find  tnem  helpful? 

_ yes 

_ no 

If  yes,  for  what  purposes? 

-  To  find  weaknesses. 

-  Common  skills  tasks. 

-  To  see  how  much  knowledge  they  get  from  the  booklets. 

15.  Are  there  other  tasks  that  could  be  taught  using 
booklets/scenarios  like  these? 

_ yes 

_ no 

If  so,  please  list  these  tasks: 

16.  General  Comments: 

-  Overall,  crews  found  these  books  fairly  hard  because 
they  are  not  trained  in  all  stations. 


1 

3 

(1  abstention) 
No  comments 


I 
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Table  D-7.  Field  Evaluation  2  - 
Evaluation  of  Degraded  Mode  Gunnery  BooKlets 


Responses 

Question 

Driver  Loader 

Gunner 

TC  Total 

The  information  booklet  (Sooklet  1) 
very  easy  to  read 

was  _ . 

1 

2 

0 

1 

4 

easy  to  read 

3 

1 

4 

5 

13 

a  little  hard  to  read 

1 

0 

0 

0 

1 

very  hard  to  read 

0 

0 

0 

0 

0 

The  information  booklet  (Booklet  1) 
too  much  information 

had  _ . 

0 

0 

0 

0 

0 

the  right  amount  of  information 

2 

2 

3 

1 

8 

not  quite  enough  information 

2 

1 

0 

4 

7 

much  too  little  information 

1 

0 

1 

1 

3 

The  information  booklet  (Booklet  1) 
very  interesting 

was _ . 

1 

0 

0 

1 

X 

2 

fairly  interesting 

2 

2 

3 

4 

11 

not  very  interesting 

1 

0 

1 

1 

3 

_ boring 

1 

1 

0 

0 

2 

After  reading  the  information  booklet  (Booklet  1)  I 

think  I 

learned 

_• 

_ a  lot 

1 

0 

0 

0 

1 

_ some 

3 

2 

3 

2 

10 

not  very  much 

0 

1 

1 

4 

6 

_ nothing 

1 

0 

0 

0 

1 

I  found  the  questions  in  the  booklet  (Booklet 
very  helpful  0 

1)  _ 
2 

0 

1 

3 

somewhat  helpful 

4 

0 

3 

4 

11 

not  very  helpful 

1 

1 

1 

1 

4 

not  helpful  at  all 

0 

0 

0 

0 

0 
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Table  D-7.  (cont 'd. ) 


Question 

6.  The  scenario  booklets  (Booklets  2 

_ very  easy  to  read 

_ easy  to  read 

_ a  little  hard  to  read 

_ very  hard  to  read 


Responses 

Dri ver  Loader  Gunner  TC  Total 
and  3)  were  _ . 

10  0  1  2 
3  3  4  5  15 

1  0  0  0  1 

0  0  0  0  0 


7.  The  instructions  for  doing  the  scenarios  were _ . 

_ very  easy  to  understand  2  0  0  1  3 

_ easy  to  understand  1  3  4  5  13 

_ a  little  hard  to  understand  2  0  0  0  2 

_ very  hard  to  understand  0  0  0  0  0 


8.  The  scenarios  were _ . 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 


110  1  3 

2  1  3  5  11 

10  10  2 

110  0  2 


9  After  doing  the  scenarios  in  Booklets  2  and  3,  I  think  I  learned  _ . 

_ a  lot  0  0  0  0  0 

_ some  4  3  3  3  13 

_ not  very  much  0  0  13  4 

_ nothing  1  0  0  0  1 


10.  The  scenario  pictures  were _ . 

_ very  realistic  0  0  0  1  1 

_ fairly  realistic  3  2  3  2  10 

_ not  realistic,  but  useful  0  10  3  4 

not  realistic  and  not  useful  2010  3 
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Table  0-7.  (cont 'd. ) 


tv, 


Question 


Responses 

Driver  Loader  Gunner  TC 


11.  When  doing  the  scenarios,  I  found  the  pictures  _ . 

_ very  helpful  1  0 

_ fairly  helpful  3  3 

_ not  very  helpful  0  0 

not  helpful  at  all  10 

12.  If  the  scenario  pictures  were  more  realistic,  it  would 


_help  a  lot 
help  a  little 

not  help,  but  would  be  nice 
make  no  difference 


2 

1 

0 

2 


1 

2 

0 

0 


1 

2 

1 

0 


0 

4 

0 

0 


1 

3 

2 

0 


1 

2 

2 

1 


Total 


3 

11 

3 

1 


4 

9 

2 

3 


13.  If  the  scenario  pictures  were  in  color,  they  would 


be  much  more  useful 
be  a  little  more  useful 


1 

0 


0 

1 


0 

3 


2 

5 


L\*. 

_ not  be  any  more  useful 

4 

2 

2 

3 

11 

■ 

14. 

The  SITUATION  descriptions  were  _ . 

_ very  easy  to  read 

2 

1 

0 

1 

4 

_ easy  to  read 

1 

2 

4 

5 

12 

>y 
.  *  „ 

_ a  little  hard  to  read 

2 

0 

0 

0 

2 

tfl 

_ very  hard  to  read 

0 

0 

0 

0 

0 

15. 

I  found  the  SITUATION  descriptions  _ 

_ very  easy  to  understand 

2 

0 

0 

1 

3 

»  * 

_ easy  to  understand 

2 

3 

4 

5 

14 

a  little  hard  to  understand 

1 

0 

0 

0 

1 

f*  ■ 

_ very  hard  to  understand 

0 

0 

0 

0 

0 
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Table  0-7.  (cont 'd. ) 


Question 


Responses 

Driver  Loader  Gunner  TC  Total 


16.  The  SITUATION  descriptions  had  _ . 

_ too  much  information  1 

_ the  right  amount  of  information  2 

_ not  quite  enough  information  1 

_ not  nearly  enough  information  1 


0  0  0 

2  2  2 

1  2  3 

0  0  1 


1 

8 

7 

2 


17.  I  found  that  the  correct  answers  were 


_very  complete  2 

jnostly  complete  0 

_complete,  but  could  use  more 
.  information  2 

incomplete,  needed  much  more 
information  1 


0 

1 

2 

0 


0  0 

3  2 

0  2 

1  2 


2 

6 

6 

4 


18.  I  found  that  the  correct  answers  were 


very  accurate  0 
usually  accurate  1 
sometimes  inaccurate  3 
usually  inaccurate  1 


0 

2 

1 

0 


0  0 

2  1 

1  3 

1  2 


0 

6 

8 

4 


19. 


Sometimes,  there  was  a 
these  explanations _ . 

brief  explanation  of 

the  wrong 

answers 

1  • 

I  found 

_ very  useful 

3 

0 

1 

1 

5 

_ fairly  useful 

0 

2 

2 

3 

7 

_ not  very  useful 

1 

1 

1 

2 

5 

_ useless 

1 

0 

0 

0 

1 

20. 


When  the  wrong  answers  were  explained, 

_ too  much  information 

_ the  right  amount  of  information 

_ not  quite  enough  information 

_ not  nearly  enough  information 


the  explanations  usually  had 
0  0  0  0 
3  12  4 

12  12 

10  10 


0 

10 

6 

2 
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Table  0-7.  (cont 'd. ) 


Responses 


Question 

Driver 

Loader 

Gunner 

I c 

Total 

The  words  used  in  the  booklets  were 

_ too  simple 

0 

0 

0 

1 

1 

_ just  right 

3 

2 

4 

5 

14 

_ sometimes  hard  to  understand 

1 

0 

0 

0 

1 

_ often  hard  to  understand 

1 

0 

0 

0 

1 

(1  abstention) 

If  many  more  degraded  mode  gunnery  scenario 

booklets 

were  available 

,  I 

would  _ . 

_ use  them  a  lot 

0 

0 

0 

0 

0 

_ use  them  sometimes 

3 

2 

3 

5 

13 

_ not  use  them  much 

1 

0 

1 

1 

3 

_ not  use  them  at  all 

1 

0 

0 

0 

1 

(1  abstention) 

If  scenario  booklets  on  other  topics 

were  available. 

I  would 

_ use  them  a  lot 

1 

0 

0 

0 

1 

_ use  them  sometimes 

3 

2 

3 

5 

13 

_ not  use  them  much 

0 

0 

1 

1 

2 

not  use  them  at  all 

1 

0 

0 

0 

1 

(1  abstention) 


24.  The  scenario  booklets  were  printed  on  regular  size  paper.  If  these 

booklets  were  made  smaller  so  they  could  fit  in  my  pocket,  I  would  _ . 

_ use  them  much  more  0  0  0  0  0 

_ use  them  a  little  more  3222  9 

_ not  use  them  any  more  than  the  way 

they  are  now  2023  7 

_ use  them  less  0  0  0  1  1 

(1  abstention) 
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Table  D-7.  (cont 'd. ) 


IL 

31 

L 


25.  QUESTION:  If  you  would  like  to  see  these  booklets  made  smaller,  what 

size  should  they  be? 

RESPONSES: 

Driver:  3  x  1,  3  x  5 

Loader:  pocket  size,  3  x  5 

Gunner:  5x9,  pocket  size 

TC:  pocket  size,  smaller  won't  help  -  pockets  filled  up  now 

26.  Other  comments: 

Driver:  No  comments 

Gunner:  Incorrect  answers  which  made  it  boring.  It  should  be  made 

by  experienced  Ml  tank  commanders  and  crew. 

TC:  Information  needs  to  be  more  accurate  and  answers  should  be 

complete  with  what  crews  have  been  trained  to  do.  The  people 
writing  the  booklets  need  to  get  themselves  familiarized  with 
the  tank  -  to  be  able  to  have  the  correct  answers  and  know 
how  the  tank  works. 

Some  of  the  questions  were  unreal  or  had  the  wrong  weapon  for 
the  wrong  target. 

There  is  some  disagreement  on  what  the  accurate  answer  should 
be. 
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Table  0-8.  Field  Evaluation  2  - 
Tank  Commander  Evaluation  of  Degraded  Mode  Gunnery  Booklets 

Question  TC  Responses 

During  the  past  week,  you  have  actually  sent  your  crew 
through  a  mini  training  program.  The  degraded  mode 
gunnery  booklets  (Booklets  1-3)  contained  notes  for 
the  tank  commander  and  instructions  for  using  the  book¬ 
lets.  How  complete  were  these  notes  and  instructions? 


_ very  complete  0 

_ mostly  complete  2 

_ complete,  but  could  use  more  information  '  3 

_ not  complete,  needed  much  more  information  1 

Most  of  your  crew  found  the  information  in  Booklet  1  _ . 

_ very  easy  to  understand  0 

_ easy  to  understand  5 

_ a  little  hard  to  understand  1 

_ very  hard  to  understand  0 


Did  any  of  your  crewmembers  have  difficulty  going  through 


the  information  booklet? 

_ yes  2 

_ no  4 

If  yes,  which  crewmember(s)  had  the  most  difficulty? 

_ Driver  2 

_ Loader  1 

_ Gunner  0 

The  language  used  in  Booklet  1  was _ . 

_ very  easy  for  your  crew  to  understand  1 

_ just  right  for  your  crew  to  understand  5 

_ a  little  hard  for  your  crew  to  understand  0 

_ very  hard  for  your  crew  to  understand  0 
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Table  D-8.  (cont'd.) 


Question 


TC  Responses 


5.  Which  crewmember(s)  would  you  want  to  be  familiar  with 
information  in  Booklet  1? 

_ Driver 

_ Loader 

_ Gunner 

6.  Most  of  your  crew  found  the  information  booklet 

(Booklet  1)  _ . 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

boring 

7.  By  doing  the  scenario  booklets,  most  of  your  crew 

learned  _ . 

_ a  lot 

_ a  little 

_ not  much 

_ nothing 

8.  Most  of  your  crew  found  the  scenario  booklets  _ . 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 

9.  Most  of  your  crew  found  the  scenarios _ . 

_ very  easy  to  do 

_ easy  to  do 

_ a  little  hard  to  do 

_ very  hard  to  do 


2 

4 

4 


0 

6 

0 

0 


0 

5 

1 

0 


0 

6 

0 

0 


0 

6 

0 

0 


D-32 


Table  0-8.  (cont 'd. ) 


Question 


TC  Responses 


10.  For  train  up  purposes,  this  set  of  booklets  is 


very  useful  0 
fairly  useful  3 
not  very  useful  3 
useless  0 


11.  For  cross  training,  this  set  of  booklets  is  _ . 

_ very  useful 

_ fairly  useful 

’ _ not  very  useful 

_ useless 

12.  If  many  more  degraded  mode  gunnery  scenario  booklets 
were  available,  how  often  would  your  crew  want  to  use 
them? 

_ very  often 

_ sometimes 

_ not  very  often 

never 


13.  If  many  more  scenario  booklets  on  other  topics  were 
available,  how  often  would  you  want  your  crew  to  use 
them? 

_ very  often 

_ sometimes 

_ not  very  often 


0 

6 

0 

0 


2 

2 

2 

0 


2 

3 

1 

0 


never 


Table  0-3.  (cont  'd. ) 


Question  TC  Responses 

14.  If  you  had  score  sheets  on  which  to  track  your  crewmem¬ 
ber's  performance,  would  you  find  them  helpful? 

_ yes 

_ no 

If  yes,  for  what  purpos. 

-  To  know  if  crew  had  general  knowledge  to  take  another 
crew  position. 

15.  Are  there  other  tasKS  that  could  be  taught  using 
booklets/scenarios  like  these? 

_ yes 

_ no 

If  so,  please  list  these  tasks: 

-  First  aid. 

-  Navigation. 

-  Putting  tank  equipment  into  operation. 

-  Operating  in  different  situations,  such  as  combat  and 
gunnery. 

16.  General  Comments: 

-  The  booklets  could  be  very  helpful  if  they  contained 
the  proper  information  and  the  proper  answers.  The 
authors  of  the  book  need  to  be  proficient  on  the  tank 
to  be  able  to  test  the  individuals  using  the  book. 

-  Need  FM-17-12-1  for  more  information  on  Ml  task. 

-  Fairly  good  (referring  to  the  training  package). 


2 

3 

(1  abstention) 


5 

1 
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Table  D-9.  Field  Evaluation  2  - 
Evaluation  or  Multiple  Returns  3ooklet 


Responses 

Question  Driver  Loader  Gunner  TC  Total 


The  information  section  was 


_ very  easy  to  read 

2 

1 

2 

0 

5 

_ easy  to  read 

0 

3 

2 

5 

10 

_ a  little  hard  to  read 

1 

0 

0 

0 

i 

_ very  hard  to  read 

0 

0 

0 

0 

0 

The  information  section  had 

_ too  much  information 

0 

0 

1 

0 

1 

_ the  right  amount  of  information 

2 

3 

2 

3 

10 

_ not  quite  enough  information 

1 

1 

1 

2 

5 

much  too  little  information 

0 

0 

0 

0 

0 

The  information  section  was _ . 

_ very  interesting 

0 

0 

0 

0 

0 

fairly  interesting 

2 

3 

3 

4 

12 

_ not  very  interesting 

0 

0 

1 

0 

1 

_ boring 

1 

1 

! 

0  0 

[1  abstention) 

2 

After  reading  the  information  section, 

I 

think  I 

learned 

_ a  lot 

0 

0 

0 

0 

0 

_ some 

2 

4 

3 

4 

13 

_ not  very  much 

0 

0 

1 

1 

2 

_ nothing  1 

I  found  the  questions  in  the  information 

0 

section 

0 

0 

1 

_ very  helpful 

1 

0 

1 

0 

2 

_ somewhat  helpful 

1 

4 

2 

5 

12 

not  very  helpful 

0 

0 

1 

0 

1 

_ not  helpful  at  all 
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1 

0 

0 

0 

1 

Table  D-9.  (cont'd.) 


Responses 

Question  Driver  Loader  Gunner  TC  Total 

2  10  0  3 

1  3  4  5  13 

0  0  0  0  0 

0  0  0  0  0 

7.  The  instructions  for  doing  the  scenarios  were  _ . 

_ very  easy  to  understand  1100  2 

_ easy  to  understand  2  3  45  14 

_ a  little  hard  to  understand  0  0  0  0  0 

_ very  hard  to  understand  0  0  0  0  0 


6.  The  scenarios  were  _ . 

_ very  easy  to  read 

_ easy  to  read 

_ a  little  hard  to  read 

_ very  hard  to  read 


8.  The  scenarios  were 


_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

boring 

9  After  doing  the  scenarios,  I  think 

_ a  lot 

_ some 

_ not  very  much 

_ nothing 


110  0  2 

1  2  3  5  11 

0  110  2 

1  0  0  0  1 

learned  _ . 

0  0  0  0  0 

2  3  3  4  12 

0  111  3 

1  0  0  0  1 


1C  he  scenario  pictures  were _ . 

_ very  realistic  1000  1 

_ fairly  realistic  2  4  4  5  15 

_ not  realistic,  but  useful  0000  0 

not  realistic  and  not  useful  0000  0 
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Table  0-9. 

(cont ‘d. ) 

-w 

Responses 

1 

Question 

Dri ver 

Loader  Gunner 

TC 

Total 

f;  11. 

When  doing  the  scenarios,  1  found 

the  pictures  _ . 

very  helpful 

0 

0 

0 

0 

0 

1  ' 

fairly  helpful 

3 

3 

4 

5 

15 

not  very  helpful 

0 

I 

0 

0 

1 

x 

■  .  ' 

not  helpful  at  all 

0 

0 

0 

0 

0 

i 

If  the  scenario  pictures  were  more 

realistic, 

it  would 

help  a  lot 

0 

1 

0 

0 

1 

_ help  a  little 

0 

2 

4 

3 

9 

-C 

not  help,  but  would  be  nice 

1 

1 

0 

2 

4 

SI 

make  no  difference 

2 

0 

0 

0 

2 

13. 

If  the  scenario  pictures  were  in  color,  they  would  _ 

• 

i 

be  much  more  useful 

0 

1 

0 

0 

1 

_ _ be  a  little  more  useful 

0 

1 

3 

4 

8 

_ not  be  any  more  useful 

3 

2 

1 

1 

7 

■  14. 

The  SITUATION  descriptions  were  _ 

• 

■ 

_ very  easy  to  read 

2 

1 

0 

0 

3 

v 

easy  to  read 

1 

3 

4 

5 

13 

V  , 

_ a  little  hard  to  read 

0 

0 

0 

0 

0 

_ very  hard  to  read 

0 

0 

0 

0 

0 

1  ,, 

I  found  the  SITUATION  descriptions 

very  easy  to  understand 

1 

0 

0 

0 

1 

r< 

easy  to  understand 

2 

4 

4 

5 

15 

a  little  hard  to  understand 

0 

0 

0 

0 

0 

J 

_ _ very  hard  to  understand 

0 

0 

0 

0 

0 

0- 

37 

J 

-V  >-  n-  ^  ^  . 

« 

Table  D-9.  {cont 'd. ) 


Responses 

Question  Dri ver  Loader  Gunner  TC  Total 


16.  The  SITUATION  descriptions  had 

too  much  information 

0 

0 

0 

0 

0 

_ the  right  amount  of  information 

2 

4 

3 

2 

11 

not  quite  enough  information 

0 

0 

1 

3 

4 

_ not  nearly  enough  information 

1 

0 

0 

0 

1 

17.  I  found  that  the  correct  answers  were 

very  complete 

0 

0 

0 

0 

0 

_ mostly  complete 

1 

2 

1 

1 

5 

_ complete,  but  could  use  more 

information 

1 

1 

2 

3 

7 

_ incomplete,  needed  much  more 

information 

1 

1 

1 

1 

4 

18.  I  found  that  the  correct  answers  were 

_ very  accurate 

0 

0 

0 

0 

0 

_ usually  accurate 

1 

3 

2 

2 

8 

_ sometimes  inaccurate 

1 

1 

2 

3 

7 

_ usually  inaccurate 

1 

0 

0 

0 

1 

19.  Sometimes,  there  was  a  brief  explanation  of 

the  wrong 

answers. 

I  found 

these  explanations  _ . 

_ very  useful 

1 

1 

1 

0 

3 

_ fairly  useful 

1 

3 

2 

2 

8 

_ not  very  useful 

0 

0 

1 

3 

4 

useless 

1 

0 

0 

0 

1 

Table  0-9.  (cont'd.) 


k*  • 


Question 


Responses 

Driver  Loader  Gunner  TC  Total 


20. 


When  the  wrong  answers  were  explained, 

_ too  much  information 

_ the  right  amount  of  information 

not  quite  enough  information 
not  nearly  enough  information 


the  explanations  usually  had 


0  10  1 
1  3  4  0 

1  0  0  4 

1  0  0  0 


2 

8 

5 

1 


21.  The  words  used  in  the  booklets  were  _ . 

_ too  simple  0  0 

_ just  right  2  3 

_ sometimes  hard  to  understand  0  1 

often  hard  to  understand  1  0 


0  0 

4  4 

0  1 

0  0 


0 

13 

2 

1 


22.  If  many  more  multiple  return  scenario  booklets  were  available,  I  would 


use  them  a  lot 
use  them  sometimes 
not  use  them  much 
not  use  them  at  all 


0  0  0  0  0 

0  4  4  3  11 

1  0  0  2  3 

2  0  0  0  2 


m 
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Table  D-1Q.  Field  Evaluation  2  - 
Evaluation  of  Target  Handoff  Exercise 


Question 


Responses 
Driver  Loader  TC 


The  instructions  for  doing  this  exercise  were 


very  easy  to  understand  1 
easy  to  understand  0 
a  little  hard  to  understand  1 
very  hard  to  understand  0 


1  2 
1  2 
0  0 
0  0 


The  target  handoff  exercise  was 

_ very  realistic 

_ fairly  realistic 

_ not  realistic,  but  useful 

not  realistic  and  not  useful 


1  1  2 
0  1  0 
1  0  2 
0  0  0 


I  found  that  this  exercise  was 

_ too  hard  to  do 

hard  to  do 

_ easy  to  do 

too  easy  to  do 


0  0  0 

1  0  0 

1  2  4 

0  0  0 


The  handoff  exercise  was 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 


1  1  1 
1  1  2 
0  0  1 
0  0  0 


This  exercise  is _ . 

_ very  useful  for  practice 

_ fairly  useful  for  practice 

_ not  very  useful  for  practice 

useless 


2  1  1 

0  1  3 

0  0  0 

0  0  0 


Table  0-10.  (cont'd.) 


Question 


Responses 

Driver  Loader  TC  Total 


6.  By  doing  this  exercise,  I  think  I  learned 


a  1  ot  1 
some  1 
not  very  much  0 
nothing  at  all  0 


0  0 

1  3 

1  1 

0  0 


1 

5 

2 

0 


7. 


By  doing  this  exercise, 

_ improve  a  lot 

_ improve  a  little 

_ stay  the  same 

_ get  worse 


l  think  my  handoff  skills  would 


1 

1 

0 

0 


2 

0 

0 

0 


1 

r 

l 

o 


4 

3 

1 

0 


8.  Was  there  anything  that  stands  out  about  this  exercise  that  you  really 
like? 

Driver:  Gunnery  because  I'm  a  Driver.  The  ride. 

Loader:  No  comments. 

TC:  It  gave  my  loader  hands-on  experience  in  the  gunner's  seat  is 

all. 


9.  Was  there  anything  that  stands  out  about  this  exercise  that  you  really 
dislike? 

Driver:  The  tank  owner  wouldn't  let  the  gun  travel  as  fast  as  possible. 
Loader:  No  comments. 

TC:  Hands-on  equipment. 


10.  If  other  types  of  handoff  exercises  like  this  one  were  available,  I  would 


use  them  a  lot 
use  them  sometimes 
not  use  tnem  much 
not  use  them  at  all 


1113 
112  4 

0  0  11 

0  0  0  0 
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Table  0-10.  (cont ’d. ) 


Question 


Responses 

Driver  Loader  TC  Total 


If  exercises  like  this  one  were  available  that  helped  me  practice  other 
skills,  I  would  _ . 

_ use  them  a  lot  1113 

_ use  them  sometimes  1  12  4 

_ not  use  them  much  0  00  0 

not  use  them  at  all  0000 


At  present,  how  much  target  handoff  practice  do  you  get? 

_ a  lot  0  0  11 

(when  in  the  field) 

_ a  little  12  2  5 

_ not  very  much  001  1 

(in  the  motor  pool) 

none  1  0  0  1 


13.  General  comments: 

Driver:  No  comments. 

Loader:  On  the  practice,  if  you  didn't  hit  center-of-mass  it  was  called 
a  miss  —  in  real  battle  if  you  didn't  hit  center-of-mass  you 
would  more  than  likely  still  get  a  hit. 

TC:  No  comments. 
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Table  0-11.  Field  Evaluation  2  - 
Evaluation  of  Target  Tracking  and  Leading  Exercise 


Responses 


Question 

Driver 

Loader 

TC 

Total 

The  instructions  for  doing  this  exercise  were 
_ very  easy  to  understand 

1 

1 

3 

5 

_ easy  to  understand 

Q 

1 

1 

2 

_ a  little  hard  to  understand 

1 

0 

0 

1 

very  hard  to  understand 

0 

0 

0 

0 

The  tracking/leading  exercise  was  _ . 

_ very  realistic 

0 

0 

1 

1 

_ fairly  realistic 

0 

2 

2 

4 

_ not  realistic,  but  useful 

2 

0 

1 

3 

_ not  realistic  and  not  useful 

0 

0 

0 

0 

During  the  exercise,  the  target _ . 

_ bounced  up  and  down  too  much 

0 

1 

1 

2 

_ looked  like  a  target  moving  over  rough 

ground 

0 

0 

2 

2 

_ did  not  move  up  and  down  much 

0 

1 

0 

1 

_ should  move  up  and  down  more 

1 

0 

1 

2 

(1  abstention) 


I  found  that  this  exercise  was 


_ too  hard  to  do 

0 

0 

0 

0 

_ hard  to  do 

0 

1 

1 

2 

_ easy  to  do 

2 

1 

3 

6 

_ too  easy  to  do 

0 

0 

0 

0 

0-43 


Table  D-ll.  (cont'd. ) 


Responses 

Driver  Loader  TC  Total 


Question 

5.  The  tracking/leading  exercise  was 

_ very  interesting 

_ fairly  interesting 

_ not  very  interesting 

_ boring 

6.  This  exercise  is _ . 

_ very  useful  for  practice  1  11  3 

_ fairly  useful  for  practice  1  13  5 

_ not  very  useful  for  practice  0  0  0  0 

useless  0  00  0 


0  0  1  1 

2  2  3  7 

0  0  0  0 

0  0  0  0 


7.  By  doing  this  exercise,  I  think  I  learned 


a  lot  0 
some  2 
not  very  much  0 
nothing  at  all  0 


0  0 
2  2 
0  2 
0  0 


0 

6 

2 

0 


8.  By  doing  this  exercise,  I  think  my  tracking/leading  skills  would  _ . 

_ improve  a  lot  12  14 

_ improve  a  little  1  01  2 

_ stay  the  same  0  02  2 

_ get  worse  0  00  0 


9.  Was  there  anything  that  stands  out  about  this  exercise  that  you  really 
like? 

Oriver:  Gunnery. 

Loader:  No  comments. 

TC:  It  has  some  benefit  as  to  doing  some  cross  training  of  a 

crewmember  in  the  motor  pool.  Learning  the  system  more  and  how 
to  track  targets  and  lead  them. 
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Table  D-ll.  (cont'd.) 


Responses 

Driver  Loader  TC  Total 


Question 


10.  Was  there  anything  that  stands  out  about  this  exercise  that  you  really 
dislike? 

Driver:  No  comments. 

Loader:  The  moving  target  bounced  up  and  down  too  much  and  you  cannot 
keep  the  same  speed. 

TC:  Could  not  lase  to  engage  L.A.S.  Also,  target  bounced  around 

with  the  stride  of  the  crewmember. 


11.  If  other  types  of  trackinq/leading  exercises  like  this  one  were 


available,  I  would  _ 

_ use  them  a  lot 

_ use  them  sometimes 

_ not  use  them  much 

not  use  them  at  all 


0 

2 

0 

0 


2 

0 

0 

0 


1 

3 

0 

0 


3 

5 

0 

0 


12. 


If  exercises  like  this  one  were  available  that 

skills,  I  would _ . 

_ use  them  a  lot 

_ use  them  sometimes 

_ not  use  them  much 

not  use  them  at  all 


helped  me  practice  other 

0  12  3 

2  12  5 

0  0  1  1 

0  0  0  0 

(1  TC  would  use  them  a 
lot  in  the  field,  but 
not  much  in  the  motor 
pool) 


Table  0-11.  (cont 'd. ) 

Responses 

Question  Driver  Loader  TC  Total 

13.  At  present,  how  much  target  tracking  and  leading  practice  do  you  get? 

_ a  lot  0011 

_ a  little  0  2  2  4 

_ not  very  much  1  0  2  3 

_ none  1  0  0  1 

(1  TC  gets  a  lot  of  prac¬ 
tice  in  the  field,  but 
not  very  much  in  the 
motor  pool ) 

14.  General  comments:  None. 
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